Since 1.16, Maps now crash mid tier devices, where as previously they passed QA

Partner Rank: 1

Partner Team Reporting: Netherpixel

Verification Build: 1.16.1

Summary: Existing maps on the store that passed QA and CERT with no greylisting now crash on Mid tier devices.

Impact: Maps that previously passed QA, and are live on the store right now. Will crash on mid tier devices. This issue also affects content being made now, 90% of the maps we have released in the last 3 months have been mid tier greylisted.

Repro Steps:
Resubmit a older map that passed QA with no greylist with a simple artwork change. QA will fail the map completely or mid tier grey list it. the maps crash on world template creation from the store download. In local testing of unencrypted map templates the issue is not detectable. Two maps have been resubmitted with no changes other than artwork: Miner Tycoon, and M1 racers.

32be2660-ad83-4583-9802-4b5239250131
81a1747f-2031-46bb-9ae2-b166105446f0

Repro Rate: 2/2
Observed Results: Maps that passed QA before 1.16 now fail CERT
Expected Results: Maps that passed Qa before will pass QA the 2nd time around if no changes are made to the map.

normal_toad
Screenshots / Videos Attached: See these CERT failures:
https://minecraftsubmissionportal.azurewebsites.net/viewReport/e0138a54-2f27-44df-8fb1-d117ea8c6fbf/

https://minecraftsubmissionportal.azurewebsites.net/viewReport/401365a6-0069-4dde-974d-060f7236d95c/

https://minecraftsubmissionportal.azurewebsites.net/viewReport/ede72f1c-3526-4094-99a5-919298d264a0/

https://minecraftsubmissionportal.azurewebsites.net/viewReport/04e4f5ee-bdcb-4e05-96ec-b5bbdbc32fea/

Regression Builds: This worked up until beta 1.16.

release.
Notes:
We noticed that from the release of 1.16 all of our maps would be greylisted. Even spawn maps with no commands or addons recived a low tier grey list. Most recieved mid tier greylists. We thought this was possibly a optimisation issue with our maps and spent a lot of time modifying and utilising lagg reduction methods such as staggering ticking rates on all command blocks, reducing ticking areas used, lowering texture sizes on addons, and pruning maps in chunker before resubmission. These attempts had limited effect, and we only managed to reduce a few mid tiers greylists to low tier with mid tier warnings.

The alarm was sounded when we resubmitted a previously QA and cert passed map call "Miner Tycoon" ( 32be2660-ad83-4583-9802-4b5239250131 ) for a simple key art change. As key art is a non-binary change this required a a "change everything" update. And the map was retested for cert a month after it's first QA pass. It failed on cert, and created crashes even on Switch Devices.Most of our maps are made purely in Bedrock by hand, with no transfers back and forth from JAVA and third party tools, eliminating the possibility of these issues being caused by corruptions from conversion.

On further review, we submitted (with the approval of Chris Dauchot) 4 test QA submissions. We resubmitted Coastal emergency as two new versions: 1 with no commands and no ticking areas, and the 2nd with just the pure build and zero addons. We also resubmitted M1 Racers (81a1747f-2031-46bb-9ae2-b166105446f0) which had passed QA with zero greylisting in April 2020. It also failed spectacularly, with a Mid tier grey list and failure on cert.