Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request: provide Openvino models #1893

Open
BBBalls opened this issue Feb 22, 2024 · 6 comments · May be fixed by #1978
Open

Request: provide Openvino models #1893

BBBalls opened this issue Feb 22, 2024 · 6 comments · May be fixed by #1978

Comments

@BBBalls
Copy link

BBBalls commented Feb 22, 2024

I have been able to appreciate significant performance increases utilizing Openvino for the models that I can covert, but my laptop does not seem to have enough ram (16 GB) to convert the large models.

If it is technically possible, it would be great if Openvino models were provided on HuggingFace, like how the CoreML models are made available.

Thanks

@twdragon
Copy link

twdragon commented Mar 15, 2024

I have converted the models to OPENVINO and strive to publish them on Huggingface soon but for now, they are available through the following IPFS folders. Every model includes the original GGML bundle accompanied by converted OPENVINO encoder files. The original pretrained OpenAI models and Large models will be added soon. The English-only models (.en.) are placed together with the multilingual ones. The links are provided using dweb.link gateway, but any of the available IPFS gateways could be used for downloading.

Model index IPFS CID HTTP Link
tiny bafybeiba7jggi3qjhxaibz6x2lj7yyodfmu3c73wam5audas4vfiyonraq Download
base bafybeidxae4d7boax6qk3qjpeodi64zp6dyxh5mrqtvroah3e54jh3w3hq Download
small bafybeiam4oa6re22vlxwylq5xfipxwudwzbeo7jyclvayvkdvwn2riqw3m Download
medium bafybeibywkcnezurmnvmikf2sungw6fz3wmq32uimoq34mcgk3weqgq7mu Download
large bafybeifatliqdfrvqlywiiiomxsa6qjprzb7fex4qfdr4cfiyt3nmcv6ri Donwload
whisper-original bafybeifiqguwimjqwhufoasmq75oyezvy2ylb6hu2evwlyqar6cvq7cjxy Download

@BBBalls
Copy link
Author

BBBalls commented Mar 15, 2024

Thanks for taking on generating the OpenVINO files and sharing them. I am not having any luck downloading the files via Kubo or the IPFS Desktop application. This is the first time I have used IPFS, so I very well might be missing something.

@twdragon
Copy link

@BBBalls there could be some problems while the data are coming over the network. I set up the providing, so in a few days everything should be fine

@twdragon
Copy link

Added Large models

@BBBalls
Copy link
Author

BBBalls commented Mar 19, 2024

@twdragon Thanks again.

twdragon added a commit to twdragon/whisper.cpp that referenced this issue Mar 20, 2024
@twdragon twdragon linked a pull request Mar 20, 2024 that will close this issue
@twdragon
Copy link

the models are added to Huggingface: https://huggingface.co/twdragon/whisper.cpp-openvino

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants