Assert when player switches dimensions with an inventory open

Verification build: r/holiday19 any

Summary: Client throws assert when player switches dimensions with an inventory open

Repro:

1. Open your inventory
2. Get teleported (for example, another player using the teleport command) to ANOTHER dimension (for example, overworld to nether)
3. Witness that the client shows assert: Container manager lifetime is managed by controller creation and destruction

Observed result: Assert shown
Expected result: No assert, client closes the inventory itself with no assert
Screenshots attached: Yes, also callstack is included

Note: This was submitted to us (Hive) as a server bug - resubmitting as client bug