Named Villagers Disappearing/Despawning

I have had villagers placed into a town for my Server and after a while they will just disappear, they have been named with a name tag and it still causes disappearances.

My world is used on my Realm.