Haste makes minning slower and drops fps

I started minning netherrack with netherite pick (efficiency V) and without any effects. It was minned very fast and I had around 44 fps

 

I gave myself haste II and the fps droped to 30 when I was idle and to 21 when I was minning. I was minning slower than no effects

 

I gave myself haste IV and the frames droped to 25 (Idle) and 15 (minning) with the prosses being even slower