Touching an end portal while in spectator mode teleports the player when they exit spectator mode

Clones MC-276843

Steps to reproduce:

• Enter spectator mode
• Touch an end or nether portal block
• Move away from the portal block
• Leave spectator mode
• You will be teleported another dimension anyway

Expected behavior:
You wouldn't be teleported as you're not touching a portal block