System wide remapped escape key doesn't work anymore

I use KDE plasma and I swapped my Escape and Caps Lock keys. I did it using the keyboard preferences in KDE, which I believe uses xmodmap.

It has never been a problem since today. I've played 1.19 for the first time and realised that my caps lock key does nothing. Pressing the physical escape key works as both escape and caps lock at the same time. And because of that every time I want to pause, I toggle my caps lock state.

The last version that my caps lock works as escape is 22w15a. On 22w16a and up it's broken.