Villagers don't locate nearest bed and job site block

villagers rarely locate the nearest bed and worksite block. I have a building full of librarians and outside I put a bed, a blast furnace, and a villager. He's supposed to turn into an armorer, but instead, he walks all the way to the other side of my base next to the building and pretending to be a librarian. It's really annoying especially when I have lots of lecterns and each villager wants the other lectern, a lectern far away from him and he's not even sleeping in the bed I put in his chamber. He's going to the bed in the chamber next to him. please fix this