But isn’t that different from “a directory containing scripts all working on the same environment” (emphasis mine). A collection of scripts that each have their own dependencies and environments is a different beast.
Maybe “one pyproject.toml == one environment” is a reasonable scope to start with. If something doesn’t fit into that mold it can wait until later.