Skip to content

Issues: casper-hansen/AutoAWQ

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

70 Open 237 Closed
70 Open 237 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Cannot copy out of meta tensor; no data!
#490 opened Jun 2, 2024 by 18827555809
cogvlm2 issue
#489 opened May 31, 2024 by BruceJust
Does AWQ and GPTQ kernels share with each other?
#485 opened May 21, 2024 by sleepwalker2017
about grid search
#484 opened May 20, 2024 by MichoChan
Support for deepseek v2
#483 opened May 14, 2024 by bks5881
1
Reduce the amount of gpu memory used in the quantification process
#482 opened May 13, 2024 by wx971025
8
Support for Traditional Linear/CNN Layer?
#480 opened May 11, 2024 by satabios
Vllm AutoAWQ with 4-GPU doesnt utilize GPU
#479 opened May 10, 2024 by danielstankw
1
anyone found the solution to this?
#477 opened May 8, 2024 by jckongucsd
After quantization，the ppl is ok but humaneval score drops sharply
#475 opened May 8, 2024 by ehuaa
2
Question about format difference between AutoAWQ and AutoGPTQ
#474 opened May 8, 2024 by xin3he
assert freqs_cis.shape == (x.shape[1], x.shape[-1])
#472 opened May 6, 2024 by pseudotensor
Need Assistance with “pip install autoawq” Error
#470 opened May 4, 2024 by ekinox971
3
torch 2.3.x support
#466 opened Apr 29, 2024 by younesbelkada
1
Phi-3 mini support?
#459 opened Apr 26, 2024 by vackosar
5
Support of llava-v1.5 and llava-v1.6 with transformers==4.40.0
#456 opened Apr 23, 2024 by WanBenLe
4
Issues with quantizing Cohere model
#455 opened Apr 22, 2024 by kwonjihun-theori
6
LLaMA-3 issues when used with vLLM
#452 opened Apr 20, 2024 by catid
5
Compare the inference speed of quantized model and unquantized model
#446 opened Apr 17, 2024 by tu2022
4
quick question around Token indices sequence length is longer than the specified maximum sequence length for this model (77697 > 32768). Running this sequence through the model will result in indexing errors
#445 opened Apr 15, 2024 by silvacarl2
Inference Parallelism Issue
#443 opened Apr 14, 2024 by Zephyr69
1
[BUG] Load StarCoder2 AWQ using Transformers
#441 opened Apr 12, 2024 by TechxGenus
1
Bug - mixtral qlora(after b&b peft train) quantization broadcast problem
#440 opened Apr 11, 2024 by orellavie1212
3
VLM quantization-aware?
#438 opened Apr 10, 2024 by SinanAkkoyun
1
AttributeError: 'LlavaForConditionalGeneration' object has no attribute 'quantize'
#436 opened Apr 10, 2024 by kzleong
3
ProTip! Follow long discussions with comments:>50.