Player turns around after leaving third person

When I am going in and out of third-person on a horse or other rideable entities, I end up being turned completely around for no reason. I don't know if this has something to do with the game thinking I am still facing the opposite after being in the front-facing perspective, but it is quite annoying when I'm riding my horse in third-person and try to flip back and I start going the wrong direction. I can't record a clip because my PC doesn't have the necessary software but this is still a problem that I face.