Character keeps facing south upon mounting a horse

My character keeps facing south when I mount a horse, making it difficult to get out of water when the shore is north, and also makes exploration and movements a hassle. Is anyone else experiencing this? Help!