Depending on if it gets worse it could be a number of things...
Wheels/Tires are the first to check. Esp wheel bearings.
Suspension components next.
Finally, check out the driveshaft. Dont remember but there may be a shaft bearing that could cause the vibration. unsure with lexus but it has happened on other real wheel drive toyotas i've owned.
good luck