Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chatBuilder.executeStream(); JAVA发起流式请求 #455

Closed
mayiyahei1992 opened this issue Apr 16, 2024 · 3 comments
Closed

chatBuilder.executeStream(); JAVA发起流式请求 #455

mayiyahei1992 opened this issue Apr 16, 2024 · 3 comments

Comments

@mayiyahei1992
Copy link

Issue you'd like to raise.

JAVA发起流式请求 接口是否是一次性全部返回 Iterator? 如果不是 我怎么提前终止他生成 这部分的 tokens怎么计算

Suggestion:

No response

@Azure99
Copy link
Collaborator

Azure99 commented Apr 18, 2024

目前暂时不支持手动终止,不过可以考虑使用stop传入停止词,当输出遇到停止词时,会终止生成(后续不计费)

@zfhlm
Copy link

zfhlm commented May 15, 2024

你好,我有个疑惑,SSE Iterator 是阻塞的,后面考虑变异步吗

@Azure99
Copy link
Collaborator

Azure99 commented May 15, 2024

@zfhlm 您好,目前暂不支持,但未来有计划支持async。

@Azure99 Azure99 closed this as completed May 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants