New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

运行chatglm3-6b-ggml int4量化模型，采用clblast加速反而比cpu加速慢很多，正常吗？ #260

Open

GTJoey opened this issue Feb 2, 2024 · 1 comment

GTJoey commented Feb 2, 2024

机器配置i7-12700F，3060显卡12GB显存，64GB 内存。

loli0123456789 commented Mar 24, 2024

机器配置i7-12700F，3060显卡12GB显存，64GB 内存。

可以先观察下推理的时候到底用的CPU还是GPU

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment