ConfidentialMind
/

Arcee-Blitz-GPTQ-G32-W4A16-MSE

Text Generation

confidentialmind

mistral-small-24b

4-bit precision

Model card Files Files and versions Community

🔥 Quantized Model: Arcee-Blitz_gptq_g32_4bit 🔥

The MSE based test did not work out too well; use non-MSE quant.

Downloads last month: 40

Safetensors

Model size

4.91B params

Tensor type

I32

·

BF16

·

FP16

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support