AutoRound(
text
AutoRound(
https://github.com/intel/auto-round
https://github.com/intel/auto-round
link
)  has been integrated into Transformers, allowing you to run AutoRound-formatted models directly in the upcoming release. Additionally, we are actively working on supporting the GGUF double-quant format, e.g. q4_k_s, stay tuned!
text
)  has been integrated into Transformers, allowing you to run AutoRound-formatted models directly in the upcoming release. Additionally, we are actively working on supporting the GGUF double-quant format, e.g. q4_k_s, stay tuned!
new_line
new_line
https://huggingface.co/blog/autoround
https://huggingface.co/blog/autoround
link
AutoRound(https://github.com/intel/auto-round)  has been integrated into Transformers, allowing you to run AutoRound-formatted models directly in the upcoming release. Additionally, we are actively working on supporting the GGUF double-quant format, e.g. q4_k_s, stay tuned!

https://huggingface.co/blog/autoround
🤗
John6666 djuna nyuuzyou ronedgecomb wenhuach
🚀
John6666
🔥
John6666