Tools (except hoe) going up very slow in main hand

When switching from item (only pickaxes, shovels, axes and swords) in any kind of condition the speed of your main hand going up is too slow. And it doesn't look like if it's supposed to be.