Support Async Tool Execution #839
gs-snagaraj
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Current
@Tool
,ToolSpecification
&ToolExecutor
support only sync operations. The Function has to reply back the right Data, to construct ToolExecutionResultMessage and continue the chain.For the multiple usecase like say we need long running job or an User input to provide the data. We should be able to pause the chain. Once we have data, construct the ToolExecutionResultMessage, add to the message list and resume.
Change Proposed:
Tool Annotation to have new attribute
boolean async default = false
DefaultAIService Proxy invoke method, execute the tool but skip ToolExectionResultMessage generation; and exit the loop gracefully.
we should able to resume
AiAssisant.resume(@MemoryId String conversionId, ToolExecutionResultMessage message)
Beta Was this translation helpful? Give feedback.
All reactions