gpt4all-ui

Simple Docker Compose to load gpt4all (Llama.cpp) as an API and chatbot-ui for the web interface. This mimics OpenAI's ChatGPT but as a local instance (offline).

Clone the repositor (with submodules)

git clone https://github.com/mkellerman/gpt4all-ui.git
cd gpt4all-ui

Copy your Models in the workspace

Models should be copied to models folder in the root of the gpt4all-ui folder.

If you have your models located somewhere else, you can create a alias (link) to your folder.

ln -s /Users/Me/Documents/Models models

Start it up

docker-compose up -d

And open http://localhost:3000

Sources:

chatboi-ui (web): https://github.com/mckaywrigley/chatbot-ui

llama-cpp-python (api): https://github.com/abetlen/llama-cpp-python