DeepSeek-R1-Distill Quantized - a neuralmagic-ent Collection

neuralmagic-ent 's Collections

Mistral Quantized

phi-4 quantized

DeepSeek-R1-Distill Quantized

Granite-3.1 Quantized

DeepSeek-R1-Distill Quantized

updated Feb 12

RedHatAI/DeepSeek-R1-Distill-Llama-8B-FP8-dynamic

Text Generation • Updated Feb 27 • 329 • 2
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8

Text Generation • Updated Feb 27 • 1.17k • 2
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16

Text Generation • Updated Feb 27 • 217
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8

Text Generation • Updated Feb 27 • 3.4k • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-FP8-dynamic

Text Generation • Updated Feb 27 • 199
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic

Text Generation • Updated Feb 27 • 543 • 3
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16

Text Generation • Updated Feb 27 • 1.01k • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8

Text Generation • Updated Feb 27 • 720 • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic

Text Generation • Updated Feb 27 • 2.84k • 6
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16

Text Generation • Updated Feb 27 • 992 • 4
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic

Text Generation • Updated Feb 27 • 16.5k • 8
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic

Text Generation • Updated Feb 27 • 15.2k • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16

Text Generation • Updated Feb 27 • 214 • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8

Text Generation • Updated Feb 27 • 868 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8

Text Generation • Updated Feb 27 • 6.98k • 4
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8

Text Generation • Updated Feb 27 • 1.52k • 10
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16

Text Generation • Updated Feb 27 • 1.37k • 4
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16

Text Generation • Updated Feb 27 • 150