Villagers Cant find Correct Pathways

Villagers that live at my house can't find a correct pathway back to their bed even though there is one. They will walk into the corners of my house from the outside and try to get in without using the doors. Ill have to break the wall to let them travel their broken pathway.