Villagers disappearing

Every world I make, the villagers keep disappearing. Doesn't matter if they're in a village or my own base. And some villages only have 2 villagers in them when you first get there, but after awhile they disappear. Sometimes when they go to bed, they float/teleport back to the nearest village, but they aren't there either when I go find them. Most of them seem to just be invisible and restarting the game doesn't seem to work.