Blocks turning transparent

In the Neon District RTX demo I was hovering above to see how much more frames I could gain and when I return to the ground I constantly get stuck and it turned out to be the building blocks stopping my movements.

It seems that the game no reads the textures into memory which turns the blocks transparent.