1.16.3 chunks load so slow that it is not rendering for a while

When i have Optifine installed on 1.16.3, sometimes chunks are loading so slow that they are not rendered. The odd thing is it happens with without Optifine. Tried optimizing the world, still doesn't work.