Villagers lock profession without being traded with (do not become unemployed when you break their workstation)

Steps to reproduce:

1. Put any job block in that villagers range
2. Wait for him to get a job that block has assigned him with
3. Save & Exit
4. Enter your world again
5. Remove the block

Expected result: villager becomes jobless.

Actual result: villager will keep his profession even if that block has been removed.

With this, the villager will lock with this profession no matter what and he hasn't even been traded with.