TIL about this flag. Until today I always had two OpenSSL builds, one with a special FIPS configuration and one without, mainly to exercise the fallbacks and so on, in addition to build bots. Usually I check the buildbots outputs but since it was during the sprint, I was likely too tired and hence introduced that regression.
That being said, I think we can add a single job that just runs some SSL-related tests with that environment.
AMD64 CentOS10 FIPS No Builtin Hashes 3.x: Buildbot
AMD64 CentOS10 FIPS Only Blake2 Builtin Hash 3.x: Buildbot
AMD64 CentOS9 FIPS No Builtin Hashes 3.x: Buildbot
AMD64 CentOS9 FIPS Only Blake2 Builtin Hash 3.x: Buildbot
And similar buildbot for stable versions. The problem is that the 3.14 and 3.15 jobs are red (fail) for a long time and so don’t report new regressions since tests were already failing
Adding new jobs on GitHub sounds like a good idea! Especially if we can only run them when “ssl code” is modified (GitHub Action already implements this logic for “SSL” jobs", we can reuse it).