Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

llama.cpp failing #371

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

llama.cpp failing #371

wants to merge 1 commit into from

Commits on Apr 22, 2024

  1. llama.cpp failing

    llama.cpp is failing to generate quantize versions for the trained models.
    
    Error:
    
    ```bash
    You might have to compile llama.cpp yourself, then run this again.
    You do not need to close this Python program. Run the following commands in a new terminal:
    You must run this in the same folder as you're saving your model.
    git clone https://github.com/ggerganov/llama.cpp
    cd llama.cpp && make clean && LLAMA_CUDA=1 make all -j
    Once that's done, redo the quantization.
    ```
    
    But when i do clone this with recursive it works.
    bet0x committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    8514d07 View commit details
    Browse the repository at this point in the history