Head moves up or down randomly when moving

Whenever I hold forward and try to move my head or vice versa, my head moves up or down.

It happens most of the time, but not everytime you boot up the game if you're lucky.

I have noticed it in 1.19 and it hasn't gone away.