Tool Holding/Usage FPS Drop

When using a regular item such as a carrot, my FPS is normal. When equipping an item such as a pickaxe or sword, my FPS drops dramatically. When using a bow this effect is increased. This is better displayed in the below images in a survival world.

Thanks!