Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to rebuild LLamaSharp backends #690

Open
kuan2019 opened this issue Apr 24, 2024 · 2 comments
Open

How to rebuild LLamaSharp backends #690

kuan2019 opened this issue Apr 24, 2024 · 2 comments
Labels
question Further information is requested

Comments

@kuan2019
Copy link

Hello,
I have checked the entire project from this repository and searched for keywords on the internet but didn't find any results. Does there has any way to rebuild backends (e.g. LLamaSharp.Backend.Cpu) ?

@AsakusaRinne
Copy link
Collaborator

If what you are asking is to compile DLLs from llama.cpp source code, please refer to this doc.

If you've already had the DLLs and want to build a nuget package, please refer to LLamaSharp.Backend.Cpu.nuspec. With the following command you'll get a nuget package. Note that you should run it in its folder, or modify the paths in the nuspec file your self. For more information, please refer to this ci script.

$ nuget pack filename.nuspec

@AsakusaRinne AsakusaRinne added the question Further information is requested label Apr 24, 2024
@martindevans
Copy link
Member

For reference, the build script which is used to generated the binaries is here. Every binary included in any of our backend packages is built with this action, you can see the complete history of runs here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants