Villagers don't make babies

Villagers seem to be willing and breeding (hearts appear above this heads) but there are no baby villagers. There are a lot of beds and bread but babies just don't appear. Tried this multiple times but there are still only 2 villagers.