Game crashes when I invite anyone

I have to manually set my skin to get into a server BUT when I do get in, it crashes as soon as I invite anyone to my server. I can run around for a bit if I'm alone but eventually it crashes and sends me to the Xbox dashboard.