Can't change custom skin unless closing out game and going back on (Using Windows 10)

The only way we can change skins on Windows 10 is by choosing the skin, but after we choose the skin it still shows the one that we previously had. But to make it work we have to exit the game then go back on.