Unemployed Villagers not claiming professions

After a raid I lost some working villagers, so I wanted to replace him with another villager. Broke that villagers workplace and set a new one, now none of the unemployed villagers won't take any jobs. This is being done in a Realm.