DeepSeek-R1-Distill-Qwen-14B

This repository contains quantized versions of the model from the original repository: deepseek-ai/DeepSeek-R1-Distill-Qwen-14B.

Name Quantization Method Size (GB)
deepseek-r1-distill-qwen-14b.fp32.gguf FP32 54.91
Downloads last month
51
GGUF
Model size
14.8B params
Architecture
qwen2
Hardware compatibility
Log In to view the estimation

4-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for pbatra/DeepSeek-R1-Distill-Qwen-14B-GGUF

Quantized
(120)
this model