Original model: https://huggingface.co/Delta-Vector/Rei-24B-KTO

EXL3 quant of the model: 8 head bits | 4 weight bits.

Downloads last month
5
Safetensors
Model size
6.57B params
Tensor type
F16
·
I16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for DeathGodlike/Rei-24B-KTO-H8-4.0bpw_EXL3