Flying underground in Spectator mode shows weird visual bugs

When you fly around in spectator mode in the ground, you may see random blocks that aren't there. If you get closer, the holes disappear. Also, some cubes of blocks will also become visible for a split second until they disappear.