sophosympatheia
/

Midnight-Miqu-103B-v1.0

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

sophosympatheia commited on Mar 7

Commit

679e207

•

1 Parent(s): a4d96fb

Update README.md

Links to more exl2 quants

Files changed (1) hide show

README.md +4 -0

README.md CHANGED Viewed

@@ -22,6 +22,10 @@ This model is based on Miqu so it's capable of 32K context.
   * [Dracones/Midnight-Miqu-103B-v1.0_exl2_2.4bpw](https://huggingface.co/Dracones/Midnight-Miqu-103B-v1.0_exl2_2.4bpw)
   * [Dracones/Midnight-Miqu-103B-v1.0_exl2_3.0bpw](https://huggingface.co/Dracones/Midnight-Miqu-103B-v1.0_exl2_3.0bpw)
   * [Dracones/Midnight-Miqu-103B-v1.0_exl2_3.5bpw](https://huggingface.co/Dracones/Midnight-Miqu-103B-v1.0_exl2_3.5bpw)
   * [Dracones/Midnight-Miqu-103B-v1.0_exl2_5.0bpw](https://huggingface.co/Dracones/Midnight-Miqu-103B-v1.0_exl2_5.0bpw)
 * If you don't see something you're looking for, [try searching Hugging Face](https://huggingface.co/models?search=midnight-miqu-103b). There may be newer quants available than what I've documented here.

   * [Dracones/Midnight-Miqu-103B-v1.0_exl2_2.4bpw](https://huggingface.co/Dracones/Midnight-Miqu-103B-v1.0_exl2_2.4bpw)
   * [Dracones/Midnight-Miqu-103B-v1.0_exl2_3.0bpw](https://huggingface.co/Dracones/Midnight-Miqu-103B-v1.0_exl2_3.0bpw)
   * [Dracones/Midnight-Miqu-103B-v1.0_exl2_3.5bpw](https://huggingface.co/Dracones/Midnight-Miqu-103B-v1.0_exl2_3.5bpw)
+  * [Dracones/Midnight-Miqu-103B-v1.0_exl2_3.75bpw](https://huggingface.co/Dracones/Midnight-Miqu-103B-v1.0_exl2_3.75bpw)
+  * [Midnight-Miqu-103B-v1.0_exl2_4.0bpw](https://huggingface.co/Dracones/Midnight-Miqu-103B-v1.0_exl2_4.0bpw)
+  * [Dracones/Midnight-Miqu-103B-v1.0_exl2_4.25bpw](https://huggingface.co/Dracones/Midnight-Miqu-103B-v1.0_exl2_4.25bpw)
+  * [Dracones/Midnight-Miqu-103B-v1.0_exl2_4.5bpw](https://huggingface.co/Dracones/Midnight-Miqu-103B-v1.0_exl2_4.5bpw)
   * [Dracones/Midnight-Miqu-103B-v1.0_exl2_5.0bpw](https://huggingface.co/Dracones/Midnight-Miqu-103B-v1.0_exl2_5.0bpw)
 * If you don't see something you're looking for, [try searching Hugging Face](https://huggingface.co/models?search=midnight-miqu-103b). There may be newer quants available than what I've documented here.