Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can provide llama.dll build guide? #10875

Closed
KiwiHana opened this issue Apr 24, 2024 · 2 comments
Closed

Can provide llama.dll build guide? #10875

KiwiHana opened this issue Apr 24, 2024 · 2 comments
Assignees

Comments

@KiwiHana
Copy link

KiwiHana commented Apr 24, 2024

ipex-llm llama.cpp has provided exe solution when build.
Can ipex-llm support to build llama.dll, llava_shard.dll, ggml_shard.dll ? dll can put into APP.

https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/llama_cpp_quickstart.html

@rnwang04 rnwang04 self-assigned this Apr 24, 2024
@sgwhat
Copy link
Contributor

sgwhat commented Apr 24, 2024

I think we could release that to meet customer's requirement.

@rnwang04
Copy link
Contributor

Hi @KiwiHana ,
We have added llama.dll, llava_shard.dll, ggml_shard.dll into ipex-llm[cpp] windows release.
You can have a try with our today's new release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants