Random chunks will bug out and stop updating when switching RTX or Deferred Rendering on and off

STEPS TO REPRODUCE:

1. Open a world
2. Toggle RTX on and off a few times
3. Some chunks will appear obviously broken with RTX off, and won't update with RTX on or off anymore.

Edit: The chunks appear to break more and more as RTX is toggled more times.