Integrate Vector Database into Llamafile #358
JohnnyOpcode
started this conversation in
Ideas
Replies: 1 comment
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I see Nvidia has come up with something like Llamafile with their NIM format. Innovation spurs innovation which is a wonderful thing.
Now I'm wondering if it would be possible to fuse a vector database into a Llamafile. The ability to have a self-contained LLM with a vector dataset really expands on the deployment scenarios. Thoughts?
Beta Was this translation helpful? Give feedback.
All reactions