Employed Villagers do not sleep in beds

I put winter villagers inside a boxed area and put little rooms with doors inside the box with the beds inside them (the job site blocks were outside the rooms). The problem is that when night time came, the villagers would not go inside the rooms and go into the beds, they would mostly just be stuck to a wall or corner and constantly disconnect and reconnect with the bed. The baby villagers were the only ones who get inside the rooms to the beds. Any fixes to this? (All the photos were taken during the night)