Game freezes when I press the menu button on Xbox Controller

When I want to open my settings in my Minecraft world the usual “return to game/settings etc” tab does not open and I cannot place blocks, delete blocks, change other players’ permissions. From the second I click the menu button on my Xbox controller, I can only move around. I cannot even access the creative inventory.