You don't stay on your horse when going into water

Is it just me or does it seem you should be able to stay on your horse when going into the water? In every other game you can. Skyrim, oblivion, and a few others. But why not minecraft? Is it suppose to be this way?