LLaMa extension for Raycast

A simple extension for Raycast that allows you to interact with llama.cpp.

NOTE: This is for experimentation purpose only. If you want to work on something similar, please fork this repo.

Screencast

llama-raycast-demo.mp4

Start LlaMa server

cd server
yarn install
yarn server <path_to_ggml_model>
# i.e: yarn server ggml-vic7b-q4_1.bin

Install dependencies & Import extension

Open Raycast launcher and import the extension

License

MIT