Edit Models filters

Model Tree

deepseek-ai/DeepSeek-R1-Distill-Llama-70B

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

56

Full-text search

Active filters: deepseek-ai/DeepSeek-R1-Distill-Llama-70B

mlx-community/DeepSeek-R1-Distill-Llama-70B-4bit

Text Generation • Updated Feb 26 • 471 • 8

unsloth/DeepSeek-R1-Distill-Llama-70B-bnb-4bit

Text Generation • Updated Feb 14 • 2.92k • 20

unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF

Updated Jan 29 • 21.2k • 76

WaveCut/deepseek-ai_DeepSeek-R1-Distill-Llama-70B_MLX-4bit

Updated Jan 20 • 15 • 1

bartowski/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated Jan 22 • 5.18k • 34

lmstudio-community/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated Jan 20 • 10.6k • 3

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_M-GGUF

Text Generation • Updated Jan 20 • 15 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q4_0-GGUF

Text Generation • Updated Jan 20 • 188 • 1

zhitels/DeepSeek-R1-Distill-Llama-70B-4bit

Updated Jan 20 • 23 • 1

Valdemardi/DeepSeek-R1-Distill-Llama-70B-AWQ

Text Generation • Updated Jan 20 • 3.35k • 16

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q6_K-GGUF

Text Generation • Updated Jan 21 • 49 • 1

mradermacher/DeepSeek-R1-Distill-Llama-70B-GGUF

Updated Jan 23 • 2.19k • 2

mlx-community/DeepSeek-R1-Distill-Llama-70B-3bit

Text Generation • Updated Feb 26 • 90 • 4

mradermacher/DeepSeek-R1-Distill-Llama-70B-i1-GGUF

Updated Jan 23 • 472 • 2

second-state/DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated Jan 22 • 393 • 1

featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation • Updated Jan 21 • 170 • 1

unsloth/DeepSeek-R1-Distill-Llama-70B-unsloth-bnb-4bit

Text Generation • Updated Feb 14 • 2.05k • 8

nm-testing/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic

Text Generation • Updated Feb 1 • 220 • 3

maus/DeepSeek-R1-Distill-Llama-70B-Q4-mlx

Text Generation • Updated Jan 31 • 80 • 3

RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic

Text Generation • Updated Feb 27 • 138k • 8

novita/DeepSeek-R1-Distill-Llama-70B-w8a8kv8-s888

Updated Feb 7 • 6 • 2

RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16

Text Generation • Updated Feb 27 • 2.05k • 3

backyardai/DeepSeek-R1-Distill-Llama-70B-GGUF

Updated Feb 12 • 737 • 1

matatonic/r1-1776-distill-llama-70b-6.5bpw-h8-exl2

Updated Feb 22 • 7 • 3

OPEA/DeepSeek-R1-Distill-Llama-70B-int4-gptq-sym-inc

Updated Mar 3 • 155 • 2

jsbaicenter/r1-1776-distill-llama-70b-FP8-Dynamic

Text Generation • Updated 15 days ago • 106 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q2_K-GGUF

Text Generation • Updated Jan 20 • 38

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_S-GGUF

Text Generation • Updated Jan 20 • 50

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_L-GGUF

Text Generation • Updated Jan 20 • 19

mmnga/DeepSeek-R1-Distill-Llama-70B-gguf

Updated Jan 21 • 176