5.0bpw EXL3 Quant of BruhzWater/Sapphira-L3.3-70b-0.2

5.0bpw H6 EXL3 quant of BruhzWater/Sapphira-L3.3-70b-0.2 using exllamav3 for quantization.

Downloads last month
11
Safetensors
Model size
22.9B params
Tensor type
F16
·
I16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for kernalkue/Sapphira-L3.3-70b-0.2-exl3-5.0bpw-h6

Quantized
(4)
this model