Realm server is very laggy when running two computers on the same LAN

I play minecraft with my son on the java version of Minecraft on a Realm I have. When we both connect on the same LAN the lag is terrible. If one of us disconnects the other experiences no lag at all. Does anyone know if there is a setting or something I can do to remove the lag for this?