Transferring control from controller to touch display or from touch display to controller shifts strength and hunger

The same thing happens when you touch the touch display on the Nintendo switch, when you touch the touch display, hunger and stamina go crazy or vice versa.