Switching to spectator mode makes all chunks unrender

See title, when you switch to spectator mode, all chunks unrender.
Tried in several worlds, server and single player.

Very rarely, entities duplicate when switching back to any other gamemode, due to being in-memory and loaded from the newly loading/rendering chunk.