Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

💡 [Question] - QwenCPP Python Binding 如何 支持 BLAS CPU 加速 #64

Open
micronetboy opened this issue Dec 15, 2023 · 2 comments
Open

💡 [Question] - QwenCPP Python Binding 如何 支持 BLAS CPU 加速 #64

micronetboy opened this issue Dec 15, 2023 · 2 comments
Assignees
@simonJJJ
Labels
question Further information is requested

Comments

@micronetboy
Copy link

起始日期 | Start Date

No response

实现PR | Implementation PR

No response

相关Issues | Reference Issues

No response

摘要 | Summary

QwenCPP Python Binding 如何 支持 BLAS CPU 加速

基本示例 | Basic Example

无

缺陷 | Drawbacks

无

未解决问题 | Unresolved questions

No response
@micronetboy micronetboy added the question Further information is requested label Dec 15, 2023
@micronetboy
Copy link
Author

micronetboy commented Dec 15, 2023 •
edited

python binding 如何设置 OpenBLAS 在CPU上加速？谢谢

python binding 如何设置 cuBLAS 在GPU上加速？谢谢

@micronetboy
Copy link
Author

llama-cpp-python 有如下的选项，qwen-cpp 是否有类似的选项？

On Linux and Mac you set the CMAKE_ARGS like this:

CMAKE_ARGS="-DLLAMA_BLAS=ON -DLLAMA_BLAS_VENDOR=OpenBLAS" pip install llama-cpp-python

@jklj077 jklj077 transferred this issue from QwenLM/Qwen Dec 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@simonJJJ simonJJJ

Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@simonJJJ @micronetboy