How much of a performance difference are you seeing?
I think Meta made some proposal at some point about having a mechanism to point to the source in a separate directory, but I don’t remember where that ended up. I don’t have a link handy, though, so this is from memory.
Otherwise the closest current proposal around this is probably “__pysource__” file layout for installed modules . Beyond that I don’t think this comes up enough for anyone to have proposed a mechanism that has been accepted.