Connecting two controllers disables the other one

Plugging in more than two controllers at once disables the other controller. I do not mean the split screen playing, but like always connecting a wired controller and a wireless controller, and use separately for convenience.

It is a minor issue though but I have no method to switch the two in-game.