I have my 2004 ES330 Sport Edition at the dealer right now for
the same transmission problem.
The service guy said they had received complaints about this
and it was a software issue.
From the posts on this site I would say they have received
many complaints.
It hesitates on acceleration badly, maybe 1-2 seconds after
pedal is depressed. Very dangerous...