Chunks not loading when I go thru the nether portal from the nether coming back

Sometimes the nether has overworld mobs like spiders, zombies, and creepers which destroys the portal from the nether's side. Other times, my friend(s) or I come back from the nether from XP farming (blaze rod spawners).  This always seems to happen ONLY when we come back from the nether.