Whenever I try to invite a friend into my server, it several times doesn't work.

We have tried multiple times to invite my friend into my server. It every time says unable to join server, or try again later. We have been trying over and over for a timespan of 3 days, and every time it fails.