You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi @tristan-k
If I understand correctly, are you running llama.cpp on your integrated graphics (Intel (R) Iris (R) Xe Graphics) on an Ubuntu system?
We have located the possible reasons for this error and trying to fix it, once it is done, we will update here to let you know.
For now, you can try ./main -m mistral-7b-instruct-v0.1.Q4_K_M.gguf -n 32 --prompt "Once upon a time, there existed a little girl who liked to have adventures. She wanted to go to places and meet new people, and have fun" -t 8 -e -ngl 30 --color to see whether it works.
Describe the bug
I'm unable to run the example from the quickstart guide for lllama.cpp. Not sure if this is related to llama.cpp or IPEX LLM.
Versions
The text was updated successfully, but these errors were encountered: