Can't connect to LAN after delay from when host joins

I can only connect to my brother's iPhone SE worlds over Wi-Fi when I select the world right when it appears. If he has been in the world for a while, my device won't connect for some reason, despite connection being fine.