Villager randomly swapping work staions

I bought each of my villagers in to my trading hall one by one. Gave them a work station and locked them in, all seems well then after a short time they seem to random swap work stations usually after a day cycle. Leaving them unable to reset their trade unless I move them all around again.

 

Please help/ fix