Edit Models filters

Model Tree

deepseek-ai/DeepSeek-R1-Distill-Llama-8B

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

97

Full-text search

Active filters: deepseek-ai/DeepSeek-R1-Distill-Llama-8B

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q3_K_S-GGUF

Text Generation • Updated 16 days ago • 31

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q3_K_M-GGUF

Text Generation • Updated 16 days ago • 52

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q3_K_L-GGUF

Text Generation • Updated 16 days ago • 32

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q4_K_S-GGUF

Text Generation • Updated 16 days ago • 10

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF

Text Generation • Updated 16 days ago • 37

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q5_0-GGUF

Text Generation • Updated 16 days ago • 31

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q5_K_S-GGUF

Text Generation • Updated 16 days ago • 26

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q5_K_M-GGUF

Text Generation • Updated 16 days ago • 51

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q6_K-GGUF

Text Generation • Updated 16 days ago • 105

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q8_0-GGUF

Text Generation • Updated 16 days ago • 536

jakiAJK/DeepSeek-R1-Distill-Llama-8B_GPTQ-int4

Text Generation • Updated 16 days ago • 1.55k

jakiAJK/DeepSeek-R1-Distill-Llama-8B_AWQ

Text Generation • Updated 16 days ago • 978

XelotX/DeepSeek-R1-Distill-Llama-8B-GGUF

Updated 16 days ago • 2.24k

mlx-community/DeepSeek-R1-Distill-Llama-8B-4bit-mlx

Updated 16 days ago • 1.17k

mlx-community/DeepSeek-R1-Distill-Llama-8B-8bit-mlx

Updated 16 days ago • 170

jesusoctavioas/DeepSeek-R1-Distill-Llama-8B-MLX-Q4

Updated 14 days ago • 10

mlx-community/DeepSeek-R1-Distill-Llama-8B-3bit

Updated 16 days ago • 15.3k

mlx-community/DeepSeek-R1-Distill-Llama-8B-6bit

Updated 16 days ago • 3.22k

numen-tech/DeepSeek-R1-Distill-Llama-8B-w4a16g128asym

Text Generation • Updated 16 days ago

mlc-ai/DeepSeek-R1-Distill-Llama-8B-q4f16_1-MLC

Updated 16 days ago • 2.19k

mlc-ai/DeepSeek-R1-Distill-Llama-8B-q0f16-MLC

Updated 16 days ago • 5

mlc-ai/DeepSeek-R1-Distill-Llama-8B-q4f32_1-MLC

Updated 16 days ago • 627

pbatra/DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • Updated 16 days ago • 564

Cran-May/DeepSeek-R1-Distill-Llama-8B-Q5_K_M-GGUF

Updated 16 days ago • 766

Cran-May/DeepSeek-R1-Distill-Llama-8B-IQ4_NL-GGUF

Updated 15 days ago • 132

featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • Updated 13 days ago • 619

osllmai-community/DeepSeek-R1-Distill-Llama-8B-GGUF

Updated 8 days ago • 2.68k

brunosk/DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF

Updated 12 days ago • 14

vankhoa/DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF

Updated 12 days ago • 11

Triangle104/DeepSeek-R1-Distill-Llama-8B-Q4_K_S-GGUF

Updated 12 days ago • 38