Villages are despawning on BTU

I have trapped villagers and I am trying to breed them on my realms server. I had 5 trapped logged out and can back in the morning and my there is 2. They started breeding again and got to 6 and left and my there is only 3.