Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More LLava style models: https://github.com/Meituan-AutoML/MobileVLM and https://github.com/vikhyat/moondream #402

Open
kinchahoy opened this issue May 7, 2024 · 2 comments

Comments

@kinchahoy
Copy link

Could we get LLamafiles for a few more small scale (i.e. ARM friendly) LLava models? If there are instructions to use the LLava 1.5 file to load projection weights from those models that would be just as useful!

@Manamama
Copy link

Manamama commented May 9, 2024

Not sure what you mean, but these Llava models have been working fine on my Droid for +2 months. Just use their GGUF versions, e.g. https://huggingface.co/ZiangWu/MobileVLM_V2-1.7B-GGUF, with the regular syntax.

@kinchahoy
Copy link
Author

Do you have llamafiles for these models? Could you share?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants