Skin switches with random players online

I use a multiplayer app (omlet) and Xbox acc, but my custom skins will 99% of the time connect with at least one other player in the world I will currently be in, and when either of us try to switch skins, the other player's skin will switch as well, making us constantly match, it is one of the most annoying glitches I've ever had to deal with.