I have a 1995 SC400 with a similar problem. I have checked grounds until I can't stand it. Lately, my battery has been down, and dealer replaced battery. No problems since - this reinforces my belief that it's a ground issue somewhere.
My problem seems to be worse when the humidity is high - the very worse when I get into the car on a muggy day after working out.