Character always faces a certain direction when changing perspective on a horse

When on a horse, minecart, or strider and you go from first person, third, second, then back to first person perspective, it will instantly rotate your camera facing south even if you aren't facing south.