When you switch to Spectator mode while sleeping, the night never skips

The Bug

If you switch to Spectator mode while sleeping (only possible with /gamemode spectator command), the night never skips.

Reproduce

• Do /time set night
• Get in a bed
• Do /gamemode spectator
  Notice the night never skips

Expected Result

The night would skip or you would be kicked out of bed