F3 Screen causes huge amount of lag

Hello Mojang, I just discovered that Minecraft drops a lot of frames when it has the F3 screen opened. 
I was standing still, getting 440 FPS and this dropped down to 360-370 when I opened the F3 screen. (I got these numbers from NVIDIA's program. I took the pictures with my phone due to Windows taking screenshots at 2 FPS.)

I feel like it should not lag as much.

Notice: I am on a server, I have not had the time to test it on singleplayer nor other snapshots and such.