🚀 AutoRound(
text
🚀 AutoRound(
https://github.com/intel/auto-round
https://github.com/intel/auto-round
link
) Now Supports GGUF Export & Custom Bit Settings!
text
) Now Supports GGUF Export & Custom Bit Settings!
new_line
new_line
We're excited to announce that AutoRound now supports:
text
We're excited to announce that AutoRound now supports:
new_line
✅ GGUF format export – for seamless compatibility with popular inference engines.
text
✅ GGUF format export – for seamless compatibility with popular inference engines.
new_line
✅ Custom bit settings – tailor quantization to your needs for optimal performance.
text
✅ Custom bit settings – tailor quantization to your needs for optimal performance.
new_line
new_line
Check out these newly released models:
text
Check out these newly released models:
new_line
🔹Intel/Qwen3-235B-A22B-Instruct-2507-gguf-q4km-AutoRound
text
🔹Intel/Qwen3-235B-A22B-Instruct-2507-gguf-q4km-AutoRound
new_line
🔹Intel/Qwen3-235B-A22B-Instruct-2507-gguf-q2ks-mixed-AutoRound
text
🔹Intel/Qwen3-235B-A22B-Instruct-2507-gguf-q2ks-mixed-AutoRound
new_line
🔹Intel/Kimi-K2-Instruct-gguf-q2ks-mixed-AutoRound
text
🔹Intel/Kimi-K2-Instruct-gguf-q2ks-mixed-AutoRound
new_line
new_line
Stay tuned! An even more advanced algorithm for some configurations is coming soon.
text
Stay tuned! An even more advanced algorithm for some configurations is coming soon.
🚀 AutoRound(https://github.com/intel/auto-round) Now Supports GGUF Export & Custom Bit Settings!

We're excited to announce that AutoRound now supports:
✅ GGUF format export – for seamless compatibility with popular inference engines.
✅ Custom bit settings – tailor quantization to your needs for optimal performance.

Check out these newly released models:
🔹Intel/Qwen3-235B-A22B-Instruct-2507-gguf-q4km-AutoRound
🔹Intel/Qwen3-235B-A22B-Instruct-2507-gguf-q2ks-mixed-AutoRound
🔹Intel/Kimi-K2-Instruct-gguf-q2ks-mixed-AutoRound

Stay tuned! An even more advanced algorithm for some configurations is coming soon.
🔥
wenhuach John6666 djuna Abhaykoul