First, have you measured that it actually gives a meaningful improvement? The same logic applies to basically all c libraries called from c++ and I don’t think I’ve ever seen anyone worry about your before.
Second, Python is compiled with a c compiler but can be called with a c++ compiler. This means that you only get one half of the mechanism: a c++ function marked with noexcept will call std::terminate if an exception is about to escape. The Python C API functions won’t do that. So all you’re getting is the assumption from the caller that it won’t happen?
It’d obviously be a bad thing if a c++ exception did propagate through the Python stack because it just isn’t designed to handle them. But there’s nothing actually stopping it.