I can't break the blocks

I am able to break blocks in Creative mode, but when in Adventure mode, it's just a single punch. Not breaking. At all. Now I've tried Survival, the block broke. In Aventure mode, I used a pick-axe and it broke this time! It was for fist. This will be hard without commands enabled.