Worlds lose data when joining friends worlds through invite

There's an irritating bug where I join a friend's world through an invite.When I leave the world and load one of my worlds, there is a chance that there is no data, nothing is in my hotbar and inventory, and I spawn back to my original spawn point when I first started the world.The only way I can get this back is by leaving the game, and reopening it, but still, it's really annoying.Please fix this.That would really be appreciated.