Asyncio support #394
Replies: 3 comments
-
@npradeep357 thanks for your comment. Could you say more about this suggestion? Where specifically would it help? |
Beta Was this translation helpful? Give feedback.
-
Okay @zainhoda, The main block points in Vanna's framework are calls to DB and calls to APIs like Google, OpenAPI or even Vanna.ai for LLM calls which are all IO calls. Waiting for them to get back with responses is the main blocking point which makes the entire application to wait until the response hits. What I suggest is making vanna asyncio natively will help in solving this issue by making these calls non-blocking and better support for libraries like asyncpg and so.. Let me know your thoughts on this. |
Beta Was this translation helpful? Give feedback.
-
@zainhoda, any suggestions or comments? |
Beta Was this translation helpful? Give feedback.
-
Providing asyncio support natively will help vanna handle IO calls in better way.
Beta Was this translation helpful? Give feedback.
All reactions