No Audio in USB Headset until I change it

When Starting Minecraft in Windowed mode (not sure if it affects other modes or not) I have no audio. My Audio device is my USB Wireless Headset (Logitech G533 Gaming Headset). If I change my Windows Audio source to the any other audio source and then back to my headset, audio begins playing in my headset. This happens on every start of the game.

Headset Drivers and Firmware up to date.