Hugging Face's logo

Qwen
/
Qwen3-235B-A22B

Text Generation
Transformers
Safetensors
qwen3_moe
conversational
Model card Files
xet
Community
34

GPTQ/AWQ

#3
by ndurkee - opened
Discussion
ndurkee

Are there plans to add GPTQ/AWQ versions like in the past?

hyunw55

https://github.com/casper-hansen/AutoAWQ

NaiveYan

Also, are there any plan for official gguf?

study-hjt

https://modelscope.cn/models/swift/Qwen3-235B-A22B-AWQ

Here is a quantized version (Unofficial)

warlock-edward

Expecting to support gptq quantization would be a great benefit for V100

Sign up or log in to comment