A/B button swap

A/B button swap doesn't work when I'm trying to sleep in a bed, and lets say I want to open chat, I have to press A not B even though I have button swap, same for if I want to leave the bed.