Slow Performance on Newer Graphics Cards

On newer graphics cards (I use GTX 650) there will often be large gaps of no performance. This is not a problem with my hardware (I can run other high-GPU intensive games fine). All settings at lowest and still does this.