httpx.AsyncClient - single vs multiple for each domain

Python Help
1

I am creating an async FastAPI service that trigger models via post requests.
Each model has a different domain.
It should support high throughput and low latency.

What is the best way managing it? with a single or multiple pools (one per domain).
What are the pros and cons and when to choose which approach?

Thanks

2

I’d use multiple pools since the each domain will have a separate socket connection and I believe that pools just reuse the existing connection to each server/domain.