AutoRound has demonstrated strong results even at 2-bit precision for VLM models like QWEN2-VL-72B. Check it out here: 
text
AutoRound has demonstrated strong results even at 2-bit precision for VLM models like QWEN2-VL-72B. Check it out here: 
https://huggingface.co/OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc
OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc
model
resource
https://huggingface.co/OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc
.
text
.
AutoRound has demonstrated strong results even at 2-bit precision for VLM models like QWEN2-VL-72B. Check it out here: https://huggingface.co/OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc.
👀
John6666 victor wenhuach lunarflu dillfrescott
🔥
wenhuach lunarflu John6666 dillfrescott
🚀
John6666 dillfrescott
6640bbd0220cfa8cbfdce080
https://cdn-avatars.huggingface.co/v1/production/uploads/6640bbd0220cfa8cbfdce080/wiAHUu5ewawyipNs0YFBR.png
John Smith
John6666
user
634772780a9fa1ac49994510
/avatars/2e88e32ac0d45a1c624026e497eb00b3.svg
wenhua cheng
wenhuach
user