After exiting a GUI, the game "spasms"

After exiting a GUI, the game "spasms"

What I expected to happen was...:
After exiting a chest of my inventory my game should run as normal

What actually happened was...:
My character looks around rapidly and in a random direction 

Steps to Reproduce:
Open inventory/chest

Exit it, with or without moving your mouse whilst exiting