Blocks freeze before get destroyed

When I try to destroy any tipe of block that isn't directly on top or below me it freezes between one second and half a second (with the hand, using a tool the time reduces) after the cracking animation ends.