Villagers disappearing

Yesterday more than half of the villagers disappeared when I logged into the server. Did I reach the maximum memory limit? It would be nice to get some warning when the limit comes up, because I spent many days to get the desired librarian villagers.