Perspective glitch when riding on something and changing perspective back to first person from third person

Its like when you ride on something like a minecart, horse, and anything rideable when you change your perspective mode back to first person from third person it makes you face/ look behind you, or to your left and right.