Can't join my brother's world and vice versa

My and my brother can't join each other's world unless we sign out, other people can join and we can both join someone else's world. We both use the same wifi (idk if that has something to do with it) and we have minecraft 1.17.34 (the latest). I have a Java ui pack but that doesn't effect it. I am on an iPhone SE first gen