Multiplayer custom skins joining bug

So my cousin and I join a world together with custom skins and every time we do I get his skin and he gets my skin. This does the same with other Android devices as well, and I don't know why.