Villagers Forget Job Sites Randomly

On my realms server, I have given each villager their own workstation separate from all other workstations. This process was done so that a workstation-villager combo was only placed after all other villagers had claimed all other workstations. This was doubled checked with commands at the time with '/data get entity @e[type=minecraft:villager,limit=1,distance=..1] Brain' to verify every villager was using the job site directly next to them.

Since then, I have noticed that the villagers will randomly forget their jobs sites, resulting in mixed up pairs and villagers standing next to unused job sites without a job site themselves.
They can no longer restock because they can't reach their new job sites, and new villagers will steal (for lack of a better term) job sites from other villagers when the enter the area.