iPad Pro (M4) Magic Keyboard Trackpad not working

I just got my new iPad Pro 13-inch (M4) and have the new Magic Keyboard with it as well. I went to play Minecraft when I got home and the keyboard functions work, to move your characters, but using the trackpad to look around does not. It works on my old iPad, but not the new one. Latest iPadOS 17.5 and Minecraft 1.20.81