Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GPTQ inference issue on intel gpu #10754

Open
a32543254 opened this issue Apr 12, 2024 · 3 comments
Open

GPTQ inference issue on intel gpu #10754

a32543254 opened this issue Apr 12, 2024 · 3 comments
Assignees
@liu-shaojun
Labels
user issue

Comments

@a32543254
Copy link

image
when I run gptq model on intel gpu, I meet above error.
Could you kindly to help to solve.
@a32543254
Copy link
Author

image when I run gptq model on intel gpu, I meet above error. Could you kindly to help to solve.

The system is Meteor Lake (MTL)

@digitalscream
Copy link

Sorry if this is stating the obvious, but...did you run source /opt/intel/oneapi/setvars.sh first?

@liu-shaojun
Copy link
Contributor

liu-shaojun commented Apr 15, 2024 •
edited

Could you provide env information using https://github.com/intel-analytics/ipex-llm/tree/main/python/llm/scripts?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@liu-shaojun liu-shaojun

Labels
user issue
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@jason-dai @digitalscream @a32543254 @liu-shaojun