Automatic Random Pause

When playing either single player or multiplayer my pointer will move onto my cross hairs then my game will pause on its own. Sometimes it will pause on its own without the pointer appearing. This happens randomly. Please fix this as it can be frustrating when I PvPing, fighting mobs, etc.