Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Any ideas what "Illegal Instruction" indicates? #13

Open
jediwarpraptor opened this issue Jul 29, 2023 · 1 comment
Open

Any ideas what "Illegal Instruction" indicates? #13

jediwarpraptor opened this issue Jul 29, 2023 · 1 comment

Comments

@jediwarpraptor
Copy link

  • Using llama-2-7b-chat.ggmlv3.q8_0.bin downloaded today
  • I've setup everything running on a Dell PowerEdge 16-processor machine w/ 128GB of RAM.
  • Pointed to a directory that only had 4 PDFs in it.
  • Every question just using your standard poetry run python main.py "question text?" returns just one line:

"Illegal instruction"

Some questions take longer to return the same.

Any clues?
@randalhsu
Copy link

Maybe you are running on a VM environment, and cat /proc/cpuinfo | grep flags has no avx or certain required flag.

In such case, try to adjust VM CPU settings.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@randalhsu @jediwarpraptor