Dear SKYVIEW,
I can think of few possible place that make such noise.
1) Driver side air conditioner vent (near to side mirror) has a flap for closing/opening of air. The flap holds sponge like material which blocks the aircon air when flap is closed but this sponge like material hardens as it ages, as a result of hardening it crack into small flake and blown out during aircon use. Often this is where wind noise comes from. Use a torch or park your car under bright daylight and take a look and try to turn the flap open & close.
2) There is a spare part called steering shaft inner cover. This covers your steering shaft and block outside noises from engine. Interestingly, this cover is placed right at the driver side thus allowing the noise to penetrate in. Check and see if it is broken. Not expensive.
I hope you get rid of the noise.