Controller buttons show up when not using a controller

The game behave as I'm using a controller(a.k.a joystick), when I'm not using one. The A,B,L1,R1 things show up when I hit the back button on my phone, which made me impossible to exit the game or view the pause menu.

My phone is OnePlus A3000 running OxygenOS.