GGML conversion of Zicklein (a German Alpaca LoRa for LLaMA). Compatible with llama.cpp version master-2d43387 or later.
The model is stored on the HuggingFace 🤗 Hub.
The script of the conversion process is in convert.sh. The model can be uploaded using upload-model.sh. Make sure to specify a commit message, e.g. ./upload_model.sh add new version.
Install python3 and git, then install the python requirements in requirements.txt, e.g.:
pip install -r requirements.txt