New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

为啥qwen.cpp在A100和A10性能差距很大 #56

Open

zhangzai666 opened this issue Dec 11, 2023 · 1 comment

zhangzai666 commented Dec 11, 2023

简单测了一下qwen.cpp在A100和A10上的性能，每秒字数A100大概是A10的两倍左右。什么原因呢

Parallel-Hao commented Dec 16, 2023

因为A100带宽是A10两倍？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment