In this repo there will be different things tested with privacy in mind. Will track outgoing network connections and the like.
We will try to do the same tests with different tools and compare results.
The initials scope of this tests will b using oobaa api mode with haystack and langchain. Will posts settings, results and prompts.
- haystack 2.0
- langchain
- text-generation-ui API mode (OAI compatible)
- apps with api access or local model loading
- vllm
- ollama
- llama.cpp
- tensorRT?
- agents?