Skip to content

Issues: mit-han-lab/smoothquant

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

54 Open 25 Closed
54 Open 25 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Huggingface_Hub Issue
#87 opened May 23, 2024 by faize5
Can SmoothQuant be used on ViT models?
#86 opened Apr 24, 2024 by n9s8a
Whether it can be supported stable diffusion
#85 opened Apr 11, 2024 by songh11
Inquiry about Int8 BMM overflow
#84 opened Apr 9, 2024 by luzai
Error when running smoothquant_opt_real_int8_demo.ipynb
#83 opened Apr 2, 2024 by kaijun924
how to use model.generate with smoothquant models
#82 opened Mar 31, 2024 by Hao-YunDeng
which version of transformer and datasets package do we need for this repo?
#81 opened Mar 28, 2024 by ghost
2
adjust activations
#80 opened Mar 28, 2024 by muzi0111
Question: why not need explicit scaling for activation X
#79 opened Mar 18, 2024 by ghost
2
Weight migration for Llama?
#77 opened Mar 14, 2024 by atyshka
Question about code
#76 opened Mar 6, 2024 by Lucky-Lance
How Can I Peft the Smoothquanted LLM?
#75 opened Mar 5, 2024 by LameloBally
1
Can I reproduce SmoothQuant on CPU only since I see that torch-int8 requires a GPU, and I am only interested in inference on the CPU?
#73 opened Feb 7, 2024 by WCSY-YG
set quantize_output True the acc drop to 0
#72 opened Jan 15, 2024 by lonleyodd
ask for a function in linear.py for smoothquant in llama @Anizpz
#71 opened Jan 2, 2024 by msz12345
w8a8 Does it require dequantization during forward inference?
#70 opened Dec 22, 2023 by shatealaboxiaowang
1
general question about SmoothQuant kv-cache quantization
#69 opened Dec 12, 2023 by brisker
Got accuray=0 when trying _real_int8_demo.ipynb
#68 opened Dec 8, 2023 by leocnj
how to reproduce ppl of wikitext2?
#67 opened Dec 6, 2023 by Arthur-Ling
1
Activation scales for bloomz 7.1b
#66 opened Dec 4, 2023 by bil-ash
1
What does the accuracy in Figure 7 of the paper mean?
#64 opened Nov 30, 2023 by YundongGai
Demo code for Bloom model?
#63 opened Nov 29, 2023 by llCurious
Inference time decreases only by 7.5% on opt-6.7B
#62 opened Oct 24, 2023 by FurryMushroom
1
pickle.UnpicklingError: invalid load key, 'v'.
#60 opened Oct 3, 2023 by baiSongL
2
which is faster between smoothquant and autogptq?
#56 opened Aug 23, 2023 by InkdyeHuang
ProTip! Add no:assignee to see everything that’s not assigned.