New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

qos模块源码有问题 #1569

Open

ghntd opened this issue May 9, 2024 · 2 comments

ghntd commented May 9, 2024

在最新版本的lmdeploy/serve/qos_engine/qos_engine.py第82行看起来应该是stream_response=True而不是源码中的true，不然true会被赋值给gen_config，导致报错。

Collaborator

lvhan028 commented May 10, 2024

多谢指出问题，能顺手提个pr修复下不？

Contributor

thelongestusernameofall commented May 11, 2024

验证下面的代码修改，即可解决问题：

bugfix

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment