[MC-33003] Setting Up Custom Skins Freeze

When I login to a server with more then 100 or so players my minecraft freezes, then I force it to quit and the log says 'Setting up custom skins' and it keeps repeating it.

Console:

Client> Setting up custom skins
Client> Setting up custom skins
Client> Setting up custom skins
Client> Setting up custom skins
Client> Setting up custom skins
Client> Setting up custom skins
Client> Setting up custom skins
Client> AL lib: (EE) alc_cleanup: 1 device not closed
Game ended with bad state (exit code 143)
Ignoring visibility rule and showing launcher due to a game crash
Deleting /Users/[User]/Library/Application Support/minecraft/versions/1.6.4/1.6.4-natives-1380338886659708000