AngelSlim/DeekSeek-R1-0528_w4a8_fp8
Updated
•
123
Deepseek-quant
The collection of quantization models of DeepSeek and Deepseek_r1_distill
-
-
AngelSlim/Deepseek_r1_distill_qwen-1_5b_fp8_static
Updated • 8 -
AngelSlim/Deepseek_r1_distill_qwen-1_5b_int4_awq
0.6B • Updated • 8 -
AngelSlim/Deepseek_r1_distill_qwen-1_5b_int4_gptq
0.6B • Updated • 8 -
AngelSlim/Deepseek_r1_distill_qwen-14b_int4_awq
3B • Updated • 67 -
AngelSlim/Deepseek_r1_distill_qwen-14b_fp8_static
15B • Updated • 11 -
AngelSlim/Deepseek_r1_distill_qwen-14b_int4_gptq
3B • Updated • 9 -
AngelSlim/Deepseek_r1_distill_qwen-32b_int4_gptq
6B • Updated • 10 -
AngelSlim/Deepseek_r1_distill_qwen-7b_int4_gptq
2B • Updated • 9 -
AngelSlim/Deepseek_r1_distill_qwen-7b_int4_awq
2B • Updated • 10 -
AngelSlim/Deepseek_r1_distill_qwen-32b_int4_awq
6B • Updated • 38 -
AngelSlim/Deepseek_r1_distill_qwen-7b_fp8_static
8B • Updated • 9 -
AngelSlim/Deepseek_r1_distill_qwen-32b_fp8_static
33B • Updated • 9