Since buildbot workers are maintained by volunteers, I understand it’s up to the individual contributing buildbot workers to decide what configurations they want to cover, but I’m sure there are scenarios where the volunteer cares about certain parameters (e.g. “I want to add free-threaded builders”, or “I care about M1 MacOS coverage”) but doesn’t care about other parameters (e.g. “what’s more valuable between refleaks, ASAN, PGO, …”).
So I’m looking for some guidance on how to choose the free parameters.
We can use the two concrete cases linked above, before attempting to make any generalized guidance.
- I have two MacOS workers (Intel + M1) that cover the default debug+nogil configuration. I think I can safely add at least one builder on each. I want to add more NoGIL coverage - what would be the most valuable configurations to add? Perhaps one Refleaks and one PGO? Would it be better to have the same configuration for both, or different configurations?
- @Rosuav has available capacity on a Debian AMD64 builder. Considering we have Ubuntu coverage of NoGIL debug and NoGIL Refleaks configurations, what might be the next most valuable configuration to add? Perhaps PGO+LTO? or ASAN?