Skip to content

little single file fronted for llama.cpp/examples/server created with vue-taildwincss and flask

Notifications You must be signed in to change notification settings

hwpoison/llama-server-playground

Repository files navigation

llama.cpp server Playground🦙

A very simple one-file playground inpired on Open-AI playground for llama.cpp http server usage. More information about server.cpp: https://github.com/ggerganov/llama.cpp/tree/master/examples/server

Screenshot

Image

Configure proxy address

Edit the vite.config.ts and change the "target" value for the llama.cpp server ip.

How to run

Install dependences

npm install

Launch server

npm run dev

Compiles and minifies for production

npm run build

It will generate a simple html that can be execute with the browser without using a server (except the llama serve.cpp runing).

About

little single file fronted for llama.cpp/examples/server created with vue-taildwincss and flask

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published