Reloading textures crashes the game

At first, I thought it was caused by a resource pack I made that changes and adds few sounds because when I kept removing and adding the resource pack the game would crash. Later I tried with the default resource pack and it still crashes when I F3 + T.

It doesn't crash every single time that I reload, but most times it crashes after 2 to 4 times.

I have no idea why this is happening and it seems to be happening on both 1.16.4 and the newest 20w45a snapshot (didn't test other versions, will do if required).