Player 1 unable to break or eat when player 2 is moving. (Splitscreen XB1)

I play console MC with a keyboard and mouse, but my younger brother wanted to join me in splitscreen. The problem I am having js that whenever he is moving or looking around I am unable to mine or eat, but I can do everything else fine. It's as if his doing actions on the controller resets my clicks. We only have the one working controller so it'd be really nice if this issue was able to be solved.