Analog stick issue with inventory screen

While using the Xbox one anolog stick to move through the inventory screen, if I tap the stick even a little in any direction, the arrow quickly jumps to the top left inventory box. This will happen even when an item is selected. Not sure if this is a built-in shortcut or a bug, but I am constantly experiencing the arrow reset its position back to the top left as I move my inventory items around. This is very frustrating. If it is a shortcut then I guess that means my controller is the primary problem, but also if it is a shortcut, I would like to know if I can turn that shortcut off.