I just did this on my 2002 LS430. No tools or prying required on this model. Just slide the plastic housing towards the passenger side, and the up and towards the front of the car.
Thanks for the help. This thread set me in the right direction and saved me a trip to the dealer.