Controls randomly become sluggish

I've found that sometimes randomly, the mouse controls will become sluggish and moving half or less rate than they should do. It's been happening through the last few snapshots.

The only remedy I've found so far is restarting the game fully, to reset the control. Quitting to the menu doesn't