Bad omen effects wont go away unless I exit and re-enter the game

I raided a pillager outpost and got the Bad Omen effect but after about 3 minutes It wouldn't go away, about an hour (irl) past and it did not, so I had to exit and re-enter my world. Quite annoying.