Changing the time with RTX/ray tracing results in rendering errors

THE BUG :

While changing the day-time, the Ray-Traced renderer does not work as intended.

We can compare that with the COVID-19 speading all arround the world (the world is going black).

See the video here : https://vimeo.com/477261759

HOW TO REPRODUCE :

Resource pack used : https://mazewave.github.io/vanilla-raytraced

Try to change the time of the world using /time set day/midnight while moving arround.

It will not work everytime, good luck with this.

MY CONFIGURATION :

RTX 2060 (6GB VRAM)
Ryzen 5 2600 (6Cores / 12 Threads)
2x8 GB of RAM DDR4 3000MHz CL 15

System : Windows 10 Professionnal Version 2004 (19041.572)

UPDATE :

The bug still occurs on last stable version of Minecraft such as 1.16.221
See my own comment for further information.