Testificate Villagers Despawning on Survival

I one time used a seed to spawn in a village. It was originally in creative mode. However once I built my house, I set it to survival, and went mining. When I came back I couldn't find a single villager.