Joining a friends world will keep disconnecting me

Both my friend and I play on Nintendo Switch. I try to join his world, but after a couple of seconds, I keep getting disconnected from him. The amount of time I can stay in his world is unpredictable before it disconnects me.