DeepSeek-R1-Distill-Llama-8B

This repository contains quantized versions of the model from the original repository: deepseek-ai/DeepSeek-R1-Distill-Llama-8B.

Name Quantization Method Size (GB)
deepseek-r1-distill-llama-8b.Q8_0.gguf q8_0 7.95
deepseek-r1-distill-llama-8b.Q4_0.gguf q4_0 4.34
Downloads last month
51
GGUF
Model size
8.03B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

4-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for pbatra/DeepSeek-R1-Distill-Llama-8B-GGUF

Quantized
(152)
this model