We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
例行检查
问题描述 通义千问流式输出的情况下function call异常,阿里官方文档显示incremental_output和stream是不支持同时设置的,但是源码中IncrementalOutput直接用request.Stream赋值了,这会使得Stream下function call输出异常
复现步骤
curl http://127.0.0.1:3000/v1/chat/completions \ -H "Authorization: Bearer sk-" \ -H "Content-Type: application/json" \ -d '{ "model": "qwen1.5-72b-chat", "stream": true, "messages": [ { "role": "user", "content": "茂名天气怎样" } ], "tools": [ { "type": "function", "function": { "name": "get_current_weather", "description": "Get the current weather in a given location", "parameters": { "type": "object", "properties": { "location": { "type": "string", "description": "The city and state, e.g. San Francisco, CA" }, "unit": { "type": "string", "enum": ["celsius", "fahrenheit"] } }, "required": ["location"] } } } ], "tool_choice": "auto" }'
预期结果 希望在Stream流式输出的情况下获得openai官方api一致的输出结果
相关截图 异常数据:
The text was updated successfully, but these errors were encountered:
另外,tool_calls也没有组装进message的消息体里面
Sorry, something went wrong.
No branches or pull requests
例行检查
问题描述
通义千问流式输出的情况下function call异常,阿里官方文档显示incremental_output和stream是不支持同时设置的,但是源码中IncrementalOutput直接用request.Stream赋值了,这会使得Stream下function call输出异常
复现步骤
预期结果
希望在Stream流式输出的情况下获得openai官方api一致的输出结果
相关截图
异常数据:
The text was updated successfully, but these errors were encountered: