Pressing F3 + N in survival or adventure switches directly to spectator

When you press F3 + N in survival or adventure the gamemode switches directly to spectator.

How to reproduce:
1. Go to survival mode.
2. Press F3 + N
What happened: You will be in spectator.
What I expected: You will be in creative
The game will also remember the gamemode you were before switching to spectator, so you will be in survival or adventure again after doing it again.