Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

请问一下在api中如何修改推理中的top_k top_p之类的参数呢 #1094

Open
KishiNaMiHakulo opened this issue May 15, 2024 · 1 comment

Comments

@KishiNaMiHakulo
Copy link

No description provided.

@KevinZhang19870314
Copy link

@KishiNaMiHakulo 看一下fast_inference_分支的api_v2.pyapi_v3.py.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants