When I try to join my friends he rarely lets me if we're not around.

When I try to join my friends he rarely lets me if we're not around. We live in the same town and only about 5 minutes. I have already tried everything to solve this problem, I have tried to remove the Game, remove and put the wifi, restart my device ...