Player walking glitches out

If you use a controller, or touch controls. Your direction of movement becomes bugged and I find myself falling off places because the movement causes me to go random directions. I can't recall having this issue with keyboard and mouse. Not completely sure if something triggers it, or if it's inconsistent.