AngelSlim/Qwen2_5-7B_instruct_fp8_static
8B
•
Updated
•
4
Qwen2/2.5-quant
The collection of quantization models of Qwen2 and Qwen2.5
-
-
AngelSlim/Qwen2_5-7B_int4_gptq
2B • Updated • 3 -
AngelSlim/Qwen2_5-7B_int4_awq
2B • Updated • 3 -
AngelSlim/Qwen2_5-1_5B_int4_awq
0.4B • Updated • 3 -
AngelSlim/Qwen2_5-1_5B_instruct_fp8_static
Updated • 6 -
AngelSlim/Qwen2_5-1_5B_int4_gptq
0.4B • Updated • 3 -
AngelSlim/Qwen2_5-32B_instruct_fp8_static
Updated • 3 -
AngelSlim/Qwen2_5-32B_int4_awq
6B • Updated • 5 -
AngelSlim/Qwen2_5-32B_int4_gptq
6B • Updated • 3