Thanks Stan, I appreciate your input and I will do the same, and see if it changes at all.
It's a common noise issue with the 3.5 when it's cold. The EXACT same thing happens to my RX350 when it's cold as well as other people's ES350. It does go away when the engine is warm.