Xbox Controller buttons seem randomly mapped.

So basically, When I connect my bluetooth xbox one controller the controls are random for example when I try to move my camera around it registers as hit, and also when i try to switch inventory spaces it puts me to the pause menu.