Villagers don't sleep in beds

I've placed 8 beds for my 6 villagers, all of them have made the sparkly "claimed" animation, but no villager ever sleeps in a bed. They just wander around outside constantly, and don't seem to even want to go into buildings at all.