Fullscreen makes bluetooth earphones (airpods) unusable

I connected my Airpods via bluetooth on my PC playing Minecraft. I wanted to play the game in fullscreen, and when I did, my Airpods didn't output sound. Going out of fullscreen does not resolve the issue. You have to remove the device in Windows settings and pair them again, and even still, I cannot play with sound in fullscreen using Airpods. I am not sure if this bug affects other bluetooth audio devices.