Owner of realm freezes constantly when mods are loaded

Loading mods onto your realm and then joining it after some time your game will just freeze however the other players don't freeze and/or crash at all they work just fine but the owner freezes and since I'm windows 10 I have to load up the task manager just to exit the game.