Character snaps to face south when mounting horse

Every time I try to mount my horse when getting it across water my character automatically faces south. This is really annoying trying to go across water and you get off the horse when it sinks into the water with you on. Can you fix this?