Violet_Magcap-12B-6bpw-h8-exl2

This is a 6bpw h8 exl2 quant of Violet_Magcap-12B

Built-in(default) calibration dataset is used.

Downloads last month
1
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for riveRiPH/Violet_Magcap-12B-6bpw-h8-exl2

Quantized
(4)
this model