Multiplayer (when I toogle on for friends it says otherwise whilst in the game)

My friend is not able to join my world but I can join their's and when I toogle multiplayer on for friends it appears as off and unchangeable whilst I'm in the game. Sometimes me and my friend don't even appear as active on Minecraft when we are.