Villagers still scared after raid

I did a raid in a village. First time went fine nothing happened. the second raid I did (witch was a lvl 1 raid on easy) caused my villagers to get stuck in their houses still scared of the raid attack. I also have got some (very minor) lag deu to the amount of villagers and iron gollems I have walking around.

1-2-3- These are the main market points where at this moment are only a few villagers (2-3)

4- It's happy hour so that should result in a high amount of villagers around the marketplaces.

But since their to scared to go outside they don't.