Chunks not loading, different for each player

Put the summary of the bug you're having here

What I expected to happen was...:

Chunks should load properly for all players. (Playing LAN with one other player and also on single player) 

What actually happened was...:
Joined player could only load 10 or 11 chunks. I cannot fully roam the world without chunks not loading properly, but more chunks load for me. (Me = host)

You can also see entities in unloaded chunks spinning/glitching in one spot

Steps to Reproduce:

Not sure what is causing the bug