unable to connect to world

so me and my friends when we invite each other we have to close app or restart the console multiple times to be able to join the game session and the internet connection is not the problem