Using Controller causes the screen to continuously look to the left and up.

I plugged a controller into my phone to play with it on my phone, but everytime I pressed any button the screen would always start moving to the left and up as if I were moving to look in those directions. I tried the controller on different consoles and it works perfectly because its brand new.