Wither Effect Doesn't Go Away

Decided to fight the wither in my world for a second time, and while fighting received the wither effect after being hit. I would drink milk to get rid of the effect and that worked fine, but when I ran out of milk the effect just wouldn't go away. I ate golden apples to restore health, but couldn't regen it fast enough before dying. Upon returning to regain my items, I died multiple times as the effect still wouldn't go away until I died. I play in hard mode, and have full protection 4 netherite armor.