Hello,
I am looking for some guidance on how to properly interact with code that runs in threads in my asyncio application. The thread is producing data for processing (thread → asnycio) and sometimes I want to send data to the thread but not very often.
So of course I searched the web and of course the documentation but found no information that was satisfying.
So I tried out different things and benched them.
First pure asyncio performance - in my case this is 1800 msgs/sec. It can’t get any faster than this.
Then interaction with a(nother) thread pool, raw performance is 31k msgs/sec
- janus
library which seems to exist exactly for this use case.
280 / 320 msgs/sec - coro
I created a coroutine that which will be called from the thread withrun_coroutine_threadsafe
520 / 700 msgs/sec
I really thought a queue would be the appropriate solution here because the thread(s) can feed data into it and it’ll act as a buffer. But it is resulting in a 85% performance penalty which is very disappointing.
Directly calling the coro from thread is much better, but still comes with a hefty performance penalty.
So I am wondering what is the recommended way to pass data between threads and asyncio code.
Thank you for your help!
Additionally I’ve observed that logging is a real bottleneck (disk I/O) so I want to move it into a separate thread.
What would be a good way to pass data from asyncio → thread?
Do I just use a queue.Queue with put_nowait
or is there some better solution?