Opening inventory causes consistent lag

When the inventory is open, whether it be survival or creative, the game consistently slows down a minor amount. This is most easily observed in an empty world as a control environment, though in certain specific situations the lag caused by this can cause the game to slow to a halt, but only when the screen is open. Attached are two images, with and without the inventory open. Note the difference of 1ms in the average frametime.