Low Villager Population

Every time I enter a village in peaceful difficulty, I only see a few villagers. After I thought of this strange thing, I tested the population spawn numbers by entering another village in easy difficulty, The village got a decent number of villagers in it. Is it a bug or something else?