Players other than first player having to start over randomly from world spawn with nothing.

If I am playing on someone else's world I am often spawned into a world I already have progress on as a new player, even though I'm using the same account, because of this I am unable to retrieve my items from end chest and use my animals that I have tamed.