My main concern is that would leave Windows ARM64 users out in the cold, as they can run 32-bit binaries (emulated) but not 64-bit. And there’s a surprising amount of demand out there - literally everyone who’s asked me why there’s no 32-bit build on the Store (still only 5-6 people) has wanted it for ARM64.
Obviously native builds are better, and I’m working behind the scenes to get CI support for it (which is blocked on having native Python support 
but at least that’s internal from my POV so I can slip them a build) and there’ll need to be some tooling improvements to handle cross-compilation (no ARM64-native compilers), but eventually it’ll all pull together. I’ve been holding off releasing a native CPython build here until there’s a way for the ecosystem to match.
So I think dropping 32-bit will be fine once we’re ready to pick up ARM64 