Need to press F3 twice to open debug menu after using game mode switcher (F3 + F4)

After using the game mode switcher, the debug menu (F3) won't open without having to press F3 twice. It happens whether or not your game mode is switched, or if you are using F4 or the mouse.