Block won't be destroyed.

When I try to destroy grassblocks with a stone shovel the blocks reappear immediatly after destruction. Think this has something to do with the tallgrass that is around the block when i try do destroy it.
And my shovel actually takes damage each time i try to destroy it. If i release the button and start again it usually works.