Raid mobs ignore me when they are tracking a villager even if i stand in front of them

I made a raid farm in a pillager outpost, and sometimes i just want to fight, but the raid totally ignore me, no matter how much I attack them, or prevents them from passing, I can be by their side without them doing anything to me