Villagers despawn even after trading

Put the summary of the bug you're having here

What I expected to happen was...:
The villager to stay in game

What actually happened was...:

Some villagers despawned after trading

Steps to Reproduce:
1. Put a step by step guide on how to trigger the bug here
2. ...
3. ...