Unintentionally flying off blocks

Whenever I mine down on a single-block wide pillar (for lack of a better term), I start to crawl visually, but immediately get back up. When I see myself crawl for less than .3 seconds, I get a strong burst of momentum in a random direction. Sometimes it's controllable, but other times I end up falling to my death.