Multiple Villagers Claim The Same Workstations

I have 2 plots of farmland and 6 farmers. i had 2 weaposmiths but the villager went back to unemployed staus after 2 or 3 hours.the farmers stay even if i break the composter. i haven't traded with all of them.