You can download models from HuggingFace https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGML https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GGUF/tree/main List of Supported models https://github.com/marella/ctransformers Dir Structure
