In the projects in the scipy/pydata stack that I am familiar with, they pin numpy in the pyproject.toml file to numpy==1.12 instead of numpy>=1.12 to avoid what you describe. In that way, in the build isolation, you always use the oldest numpy version supported. See eg https://github.com/scipy/scipy/blob/master/pyproject.toml