Player remains in world after leaving the world when joining a friend's world

When a player is leaving on a friend's world while we're connecting to the world, the player remains in the world after we successfully joined the world.

This might be a little bit tricky to reproduce:
1. Have a world loaded with a friend inside (call it Player A).
2. Tell Player B to connect to your world.
3. Player B should be in Generating world screen, tell Player A to leave.
4. Player B joined the world and can see Player A but the Host player can't see Player A at all.

In some cases, Player B should be able to see Player A's left the world text when this happens.

Device:
Xiaomi Redmi Note 4X