Multiplayer Issues

Recently, me and one of my friends have been having trouble connecting to each other's worlds. Sometimes I can connect to their world but they can't connect to mine or vice versa. Sometimes neither can connect. It just seems to happen randomly with little or no warning