Horses can glitch when moving up blocks

The bug

Horses will sometime glitch when riding them while moving up blocks. An error appears in the game output when this happens:

Horse moved wrongly!

How to reproduce

1. Tame a horse
2. Ride the tamed horse and go up blocks
   → The horse will sometimes glitch

See 2019-04-10 16-41-21.mp4 if you have trouble reproducing.