Phantoms spawning inside when player is inside.

While working inside a woodland mansion if I go to the first floor and back up to the third phantoms have spawned inside the third floor. They aren't supposed to spawn if you have a solid block above you.