Enabling a Custom Skin forces other players using a custom skin to use your skin

I'm Playing multiplayer with my friend, and when i switch to my custom skin while he has his custom skin on, his skin switches to my custom skin, and whenever he refreshes his skin, it's forced onto my character.