Barrrrry
/

DeepSeek-R1-W4AFP8

Model card Files Files and versions Community

DeepSeek-R1-W4AFP8

This model is a mixed-precision quantized DeepSeek-R1, with dense layer using FP8_BLOCK_SCALING, MoE layers uses INT4 weights and FP8 activation.

Downloads last month: 83

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Barrrrry/DeepSeek-R1-W4AFP8

Base model

deepseek-ai/DeepSeek-R1

Quantized

(55)

this model