Friends cant join after Adding mods

My friends have the problem that everytime they try to join my World they need to download the modpacks (even if they have already did it one time) but then it stops after i leave the world it loads again but its still very annoying because it Takes 5 Minutes every time i load into my World