Switching X sessions locks up the game.

Switching X sessions (switching to a virtual terminal and doing "startx") locks up the client. I was expecting it to just not render, but audio doesn't play and packets don't get processed.