Infinite bad omen effect in survival

Whenever i find the pillager outpost and kill the leader (the banner guy) it gives me infinite bad omen effect. There does not seem like there is a way in survival for me to remove it. So when i entered a village it started a raid. Look at the picture to see.