Villagers escape from places they cant fit

I trap villagers with a one block hole so they can have room to trade. After I leave the spawn chunks, leave the game, die, ext.. they are somehow out!! I have no idea why or how this happens, and it is very annoying because they KEEP DYING, and do not respawn.