Villagers disappearing

I have my villagers in a place where they cannot get out of and yet whenever they breed and a new villager comes along one of the villagers already there and fully maxxed out trading with vanishes. I haven't been on any difficulty with mobs so they haven't been killed by them or anything else where they are so I'm really not sure how it's happening