Villagers won’t claim another job

When I cure a zombie villager it already spawns with a job and workspace, but their work block isn’t in a 100 block radius. They won’t unemployment from their job and continue to walk around aimlessly. I set a new (different) job block in front of them and they don’t unemploy. Note: I haven’t traded with these villagers yet.