Villager Despawning Resulting Librarian Working on Composters!!!

I'm on pure survival mode with no cheats. I found a desert Village with 2 farmers, after logging out and entering the game, those Villagers disappears resulting a Librarian working around Composters.