Villagers Have Trouble Pathfinding to Job Site Blocks when Ladders and/or Stairs Involved

I was building a small village in a Superflat world, and one of the buildings I created was this (please see attachments). At night (if they couldn’t find a bed) they would all ascend the ladders and get stuck on the open trapdoors until I gave them a nudge towards the center of the ladder(s), but during the day they would just wander cluelessly about the lower level and continually change profession. Also, I have noticed that they have trouble getting to job site blocks using stairs that naturally generate in some Desert Villages. 
Thank you so much for your service! Have a great day/night!