Minecraft making buzzing sound

Minecraft is making a weird buzzing sound in fullscreen, it changes pitch with changing the framerate limit. I tried deleting the "assets" folder but that didnt help.(https://bugs.mojang.com/browse/MC-94756)

It is in all versions of minecraft.

 

Update: It continues a while with the sound after going out of Fullscreen.

Update #2: The sound seems to be made with every new frame, it also doesnt change pitch, it just gets played a lot more. Not being in fullscreen now doesnt stop the sound.