Is it possible to use a local build backend?

PEP 517 Backend bootstrapping

In this thread it becomes pretty clear that the only use case intended for backend-path is the bootstrapping use case, and indeed there is a check implemented that the backend-path must be relative to the project to be built and going up with specifying ../ paths leads to an exception unfortunately.