Can't break some blocks with a simple block

When you try to break some blocks with a simple click, the block disappear then reappear. You need to hold the button in order to break it. I've tried this with other blocks like sand and it's the same thing, but not for TNT for example.