2/3 bits OPEA/Llama-3.3-70B-Instruct-int2-sym-inc 9B • Updated Apr 30 • 27 OPEA/Llama-3.3-70B-Instruct-int3-sym-inc 10B • Updated Apr 30 • 11 OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc 9B • Updated 23 days ago • 28 • 5 OPEA/Qwen2.5-72B-Instruct-int2-sym-inc 8B • Updated Apr 30 • 19 • 1
Llama-AutoRound OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc 11B • Updated Apr 24 • 37 OPEA/Llama-3.3-70B-Instruct-int4-sym-inc 11B • Updated Apr 30 • 40 OPEA/Meta-Llama-3.1-70B-Instruct-int4-asym-inc 11B • Updated Apr 30 • 7 • 1 OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc 11B • Updated Apr 24 • 19 • 1
QWEN-AutoRound OPEA/Qwen2.5-7B-Instruct-int4-sym-inc 2B • Updated Apr 30 • 31 • 1 OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc 6B • Updated Apr 30 • 25 • 1 OPEA/Qwen2.5-3B-Instruct-int4-sym-inc 0.7B • Updated Apr 30 • 26 OPEA/Qwen2.5-72B-Instruct-int4-sym-inc 12B • Updated Apr 30 • 13 • 1
DeepSeek OPEA/DeepSeek-V3-int4-sym-gptq-inc Updated Apr 30 • 1.86k • 17 OPEA/DeepSeek-V3-int4-sym-awq-inc Updated Apr 30 • 83 • 4 OPEA/DeepSeek-V3-int4-sym-gguf-q4-0-inc 671B • Updated Feb 12 • 155 • 3 OPEA/DeepSeek-R1-int4-sym-gguf-q4-0-inc 671B • Updated Mar 11 • 227 • 14
VLMs-AutoRound OPEA/Qwen2-VL-7B-Instruct-int4-sym-inc 3B • Updated 23 days ago • 29 • 1 OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc 3B • Updated 23 days ago • 115 • 2 OPEA/SmolVLM-Instruct-int4-sym-inc 0.9B • Updated 23 days ago • 25 • 3 OPEA/llama-joycaption-alpha-two-hf-llava-int4-sym-inc 2B • Updated 23 days ago • 1.84k • 4
2/3 bits OPEA/Llama-3.3-70B-Instruct-int2-sym-inc 9B • Updated Apr 30 • 27 OPEA/Llama-3.3-70B-Instruct-int3-sym-inc 10B • Updated Apr 30 • 11 OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc 9B • Updated 23 days ago • 28 • 5 OPEA/Qwen2.5-72B-Instruct-int2-sym-inc 8B • Updated Apr 30 • 19 • 1
DeepSeek OPEA/DeepSeek-V3-int4-sym-gptq-inc Updated Apr 30 • 1.86k • 17 OPEA/DeepSeek-V3-int4-sym-awq-inc Updated Apr 30 • 83 • 4 OPEA/DeepSeek-V3-int4-sym-gguf-q4-0-inc 671B • Updated Feb 12 • 155 • 3 OPEA/DeepSeek-R1-int4-sym-gguf-q4-0-inc 671B • Updated Mar 11 • 227 • 14
Llama-AutoRound OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc 11B • Updated Apr 24 • 37 OPEA/Llama-3.3-70B-Instruct-int4-sym-inc 11B • Updated Apr 30 • 40 OPEA/Meta-Llama-3.1-70B-Instruct-int4-asym-inc 11B • Updated Apr 30 • 7 • 1 OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc 11B • Updated Apr 24 • 19 • 1
VLMs-AutoRound OPEA/Qwen2-VL-7B-Instruct-int4-sym-inc 3B • Updated 23 days ago • 29 • 1 OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc 3B • Updated 23 days ago • 115 • 2 OPEA/SmolVLM-Instruct-int4-sym-inc 0.9B • Updated 23 days ago • 25 • 3 OPEA/llama-joycaption-alpha-two-hf-llava-int4-sym-inc 2B • Updated 23 days ago • 1.84k • 4
QWEN-AutoRound OPEA/Qwen2.5-7B-Instruct-int4-sym-inc 2B • Updated Apr 30 • 31 • 1 OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc 6B • Updated Apr 30 • 25 • 1 OPEA/Qwen2.5-3B-Instruct-int4-sym-inc 0.7B • Updated Apr 30 • 26 OPEA/Qwen2.5-72B-Instruct-int4-sym-inc 12B • Updated Apr 30 • 13 • 1
