I had the same problem with windows on driver and passenger doors.
Cleaned and lubed all the door seals...no change.
Then i also noticed that it would go away when the windows were a bit opened.
So i gave the windown seals some silicone spray ( especially between the seals at the top of the window)
Noise is completely gone now. Easy fix once you locate it
