Villagers Sometimes refusing to sleep ever again

So I've been playing a world for a little, and only 2 - 3 nights have past since I first created the world. Some of the villagers slept for the first 2 days. But then some of the villagers just wanted to stand outside of their house like 2 blocks away from their bed.