New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

在将部分层进行剪枝之后，不能直接通过tgi加载模型 #41

Open

coderchem opened this issue Dec 1, 2023 · 0 comments

coderchem commented Dec 1, 2023

在将部分层进行剪枝之后，不能直接通过tgi加载模型，落地难度大，有什么好的idea吗？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment