Villagers Disappear Randomly

Just as the title says. My villagers are disappearing in single player, not sure about on a server yet. After working them and leveling them up, they're just gone. Very very frustrating as villager play is part of what i really enjoy in the game. Please fix.