I can't join onto my friend's LAN world.

I can't join onto my friend's Minecraft world. They can join onto mine with no issue. When I try to join it says I left the game when I never joined. On my screen, it says "Unable to connect to world".