Villagers patrols spawn too frequently

I play on a bedrock dedicated server from my iPad and my xbox one, I am frequently pestered by pillager patrols, they appear inside my build and I am even finding them in the roof space of my house and in the End dimension, and if I take out once patrol, I only get about 30 minutes before another once comes by.  I thought these patrols were supposed to be rare!