Efficiency doesn't work on shovels!?

Efficiency doesnt't work for shovels. I tried to dig normal dirt with eff 4 diamond shovel and it broke the speed of a normal shovel. I tried with effiency 5, still no luck, tried with iron shovel instead of diamond, still no luck.