Java Crashing

Hi, whenever I go to join some servers, (it doesn't happen on all of my servers,) the game freezes up and a tab appears that says, "Java(TM) Platform SE binary has stopped working", and the only option I have is to close the window. I don't know if this is the server, Minecraft, Java, or even my computer; but I hope you can help me out!