Skip to content

A platform to test multiple LLM models inside a RAG workflow to choose the best model for embedding and retrieval and the best prompt according to the use case

Notifications You must be signed in to change notification settings

riolaf05/multimodel-rag-platform

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

69 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Setup

Setup docker (Ubuntu 22.04) see https://docs.docker.com/engine/install/ubuntu/

sudo apt-get update
sudo apt-get install ca-certificates curl gnupg
sudo install -m 0755 -d /etc/apt/keyrings
curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg --dearmor -o /etc/apt/keyrings/docker.gpg
sudo chmod a+r /etc/apt/keyrings/docker.gpg

# Add the repository to Apt sources:
echo \
  "deb [arch="$(dpkg --print-architecture)" signed-by=/etc/apt/keyrings/docker.gpg] https://download.docker.com/linux/ubuntu \
  "$(. /etc/os-release && echo "$VERSION_CODENAME")" stable" | \
  sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
sudo apt-get update

sudo apt-get install docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin -y

Git clone

git config --global credential.helper store
git clone https://github.com/riolaf05/chatgpt-summmary
sudo docker login

Create certificates

cd certs
mkcert llm.rioengineers.com "*.rioengineers.com" localhost 127.0.0.1 ::1

Setup with Docker

  1. Copiare a man .env e config

  2. Run

sudo docker run --name riassume -it -d -p 80:8501 -v ./config.yaml:/app/config.yaml -e OPENAI_API_KEY=<env> -e AWS_ACCESS_KEY_ID=<env> -e AWS_SECRET_ACCESS_KEY=<env> -e AWS_REGION=us-east-1 --restart unless-stopped rio05docker/chatgpt-summary:0.0.10

References

About

A platform to test multiple LLM models inside a RAG workflow to choose the best model for embedding and retrieval and the best prompt according to the use case

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published