Inventory will not open inside of boat when playing on controller

I was in the middle of an ocean when I tried to open my inventory to get some food when it wouldn't open. I tired hitting the two buttons that open my inventory on the controller multiple times to no avail. Then I tried it on my connected keyboard, and lo and behold it does open with a keyboard and mouse, but not my controller.