Point of view gets reset while riding a minecraft which glitches through a block

You point of view gets reset (so to first person point of view) while riding a minecart when the cart glitches through a solid block.
This does not happen every time, since it seems to depend on in which direction you are looking.