Joining Bug

Whenever I join my brother, not specifying his name, I find that it kicks me off a lot. So much so that I am forced to fight with merely getting onto the game. After I join said game, it kicks me off, giving me text saying "Timed out", "The host has left", Ect, even if it doesn't make sense, as he didn't get off. Hopefully you can fix the problem.