Can't disable F3

Pressing F3 will open the debug console and will allow all of the F3 key shortcuts to be used but there is no way to quit the debug console. If you leave the game (single player) or leave the server (multiplayer) and log back in the debug console will vanish but the F3 key shortcuts are still active and can be used. This happens with any resource pack including default, any server and any single player world.