Unable to connect the world

Hello,everytime i join my friend's multiplayer world (me and him) it says "unable to connect the world" sometimes i join the world with no problems but i have to try joining 5-10 times,please fix this,(also we both play on PS4)