Villagers are randomly despawning

Was making a village and I transported a bunch of villagers to it but one day when I logged on half of them had disappeared. I have traded with them frequently and it just makes no sense