Illager Patrols Spawn and Attack PC inside fence.

I was attacked in daylight, by an Illager patrol of 5, containing a captain with banner, two archers, and I'm not sure what the other two were since I was fighting. They spawned INSIDE the outer property fence, in light of 10-12, with all gates closed and a block gap outside the fence and no overhanging trees. This is the third attack in 24 real hours. The others being outside, and provoked by my entering agg range of a single vindicator. I do not have any villager entities in my house and grounds. I am unhappy. If I want to sneak around in fear and die, I can play ESO. I play Minecraft to mine and craft, not be attacked on my own property. I have no pictures, I was a bit busy, trying to get rid of them