pillagers

its really annoying how in my realm pillagers spawn randomly near me..in my realm i have a base by a village ( to trade).. and pillagers spawn inside and kill my villagers..the thing is there is no pillager tower near me nor did i trigger a raid..its always three pillagers sometimes its multiple in groups of 3 and i know its not because im near a village..they spawn EVERYWHERE I GO ! even when im swimming in the ocean they will spawn..its very annoying and i hope this is a bug and not just a new thing that came with the fox update because thats when it started.. i really want this bug to go away because im a very big fan of minecraft and this issue makes me not even want to play