Game Freezes after changing difficulty playstation 5

Sometimes when you change the difficulty on playstation 5 (don't know if it is also the case for ps4) the game freezes and you can't do anyting or you stuck in the game/settings menu. The only solution is to restart the game by closing and launching again.

I've mainly have this when switching from hard to peacefull difficulty.