Pillar Patrol Units Spawnrates

Patrol units are spawning way to frequently, and I am not even near a village. I understand that they will spawn and try to kill the player, but I had one patrol unit after another, in about a 2 minute time span.