JayhC
/

Llama-3-Lumimaid-70B-v0.1-3bpw-h6-exl2

Text Generation

Not-For-All-Audiences

nsfw

text-generation-inference

Model card Files Files and versions Community

JayhC commited on May 3, 2024

Commit

199813e

·

verified ·

1 Parent(s): 149c091

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -6,7 +6,7 @@ tags:
 ---
 <br/><br/>
-8bpw/h8 exl2 quantization of [NeverSleep/Llama-3-Lumimaid-8B-v0.1](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1) using default exllamav2 calibration dataset.
 ---

 ---
 <br/><br/>
+3bpw/h6 exl2 quantization of [NeverSleep/Llama-3-Lumimaid-70B-v0.1](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-70B-v0.1) using default exllamav2 calibration dataset.
 ---