Villager Pathfinding Issues with Ladders & Walls

My villagers are seeming to get stuck whenever I place ladders in the village. They always just get stuck on them and can't seem to make it to their workstation, even if it is in the same room as the ladders. Additionally, Villagers will have a hard time going to bed and pathfinding along walls, once again just getting stuck. It's making trading difficult as villagers are not restocking their trades unless I physically break the ladder or walls!