FP8 Deepseek R1 Distilled LLMs for SGLang and vLLM - a JamAndTeaStudios Collection

JamAndTeaStudios 's Collections

FP8 Deepseek R1 Distilled LLMs for SGLang and vLLM

FP8 Deepseek R1 Distilled LLMs for SGLang and vLLM

updated Jan 29

Accurate FP8 quantized deepseek R1 distilled models, ready for use with SGLang and vLLM!

JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-1.5B-FP8-Dynamic

Text Generation • Updated Jan 29 • 56
JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-7B-FP8-Dynamic

Text Generation • Updated Jan 29 • 132 • 1
JamAndTeaStudios/DeepSeek-R1-Distill-Llama-8B-FP8-Dynamic

Text Generation • Updated Jan 29 • 132 • 1
JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-14B-FP8-Dynamic

Text Generation • Updated Jan 29 • 254 • 1
JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-32B-FP8-Dynamic

Text Generation • Updated Jan 29 • 148 • 2
JamAndTeaStudios/DeepSeek-R1-Distill-Llama-70B-FP8-Dynamic

Text Generation • Updated Jan 29 • 590