VIllagers lose bed. (stop defining as a village)

In my Iron farm, I use trapdoors with a redstone clock, that opens the trapdoors after 10 seconds. When they slept it works, and then after I am away for some time, either unloading chunks or busy around, they dont use their beds anymore. Because once at nighttime, the villagers get the green particles that they decide to use the bed.