Connection issue w/ players on same Internet joining the same Realm.

When trying to connect on my PC w/ Windows 10 on a direct Ethernet connection while my friend is on the Wifi, it boots him off of the server. But when I am on my cell phone with its data on my same Account, I am able to join and play WITH him. It only seems to boot him off when we are on the same Internet connection.