My Villagers keep Despawning

I have a small village whose population I grow, but a after number of times logging back to my Minecraft, they despawn and only one or three are left. Its very frustrating, because of these villagers are upgraded in their occupation and they still despawn