Villagers do not assign to closest work station

Villagers do not chose the closest work station as their own, instead will chose work station up to 96 blocks away even when testing. This is incredibly frustrating and not at all intuitive.