Any functionality in stdlib has its own maintenance cost.
If a third-party library on PyPI solves your needs – that’s fine, please use it.
When we start feeling the high demand for the library, this situation can be a reason for embedding it into stdlib.
For asyncio-rlock I see very few usages on the github. Maybe the feature request is not very popular?