Grass Blocks Immune To Efficiency

I was flattening the top of a hill with my diamond shovel. It has efficiency 3 on it and was obliterating the dirt blocks as per usual, but I noticed it was a lot slower on blocks with grass on them. I made another diamond shovel leaving it unenchanted and it was breaking the grass blocks at the same speed as the enchanted one.