DeathGodlike
/

Rei-24B-KTO-H8-4.0bpw_EXL3

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

DeathGodlike commited on about 22 hours ago

Commit

da64e1c

·

verified ·

1 Parent(s): aa5e8d8

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -11,6 +11,6 @@ tags:
 - mistral
 ---
-EXL3 quant with 8 head bits and 4 weight bits.
-Original model: https://huggingface.co/Delta-Vector/Rei-24B-KTO

 - mistral
 ---
+Original model: https://huggingface.co/Delta-Vector/Rei-24B-KTO
+EXL3 quant of the model: 8 head bits | 4 weight bits.