thank you.. any plans to add AWQ quantization of this model?
#1
by
appakaradi
- opened
thank you.. any plans to add AWQ quantization of this model?
As far as I know, the Qwen team will soon provide AWQ quantification weights and GGUF quantification files. You can always follow if anyone else in the community provides AWQ quantification weights. If not, I will try to provide AWQ quantification files. Thank you very much for following my repository