Server Issues

So, my problem is that I have Minecraft and my friend has Minecraft and we go to his house to play sometimes. The problem that keeps occurring is that I or my friend can't connect to each others server using Lan connections.