Update README.md
Browse files
README.md
CHANGED
@@ -10,9 +10,16 @@ EXL3 quants of [Darkhn/L3.3-70B-Animus-V1](https://huggingface.co/Darkhn/L3.3-70
|
|
10 |
|
11 |
### Quants
|
12 |
| Quant(Revision) | Bits per Weight | Head Bits |
|
13 |
-
| -------- | ---------- | ---------
|
|
|
|
|
14 |
| [3.5_H6](https://huggingface.co/ArtusDev/Darkhn_L3.3-70B-Animus-V1-EXL3/tree/3.5bpw_H6) | 3.5 | 6 |
|
|
|
|
|
|
|
15 |
| [6.0_H6](https://huggingface.co/ArtusDev/Darkhn_L3.3-70B-Animus-V1-EXL3/tree/6.0bpw_H6) | 6.0 | 6 |
|
|
|
|
|
16 |
|
17 |
### Downloading quants with huggingface-cli
|
18 |
|
|
|
10 |
|
11 |
### Quants
|
12 |
| Quant(Revision) | Bits per Weight | Head Bits |
|
13 |
+
| -------- | ---------- | ---------
|
14 |
+
| [2.5_H6](https://huggingface.co/ArtusDev/Darkhn_L3.3-70B-Animus-V1-EXL3/tree/2.5bpw_H6) | 2.5 | 6 |
|
15 |
+
| [3.0_H6](https://huggingface.co/ArtusDev/Darkhn_L3.3-70B-Animus-V1-EXL3/tree/3.0bpw_H6) | 3.0 | 6 |
|
16 |
| [3.5_H6](https://huggingface.co/ArtusDev/Darkhn_L3.3-70B-Animus-V1-EXL3/tree/3.5bpw_H6) | 3.5 | 6 |
|
17 |
+
| [4.0_H6](https://huggingface.co/ArtusDev/Darkhn_L3.3-70B-Animus-V1-EXL3/tree/4.0bpw_H6) | 4.0 | 6 |
|
18 |
+
| [4.25_H6](https://huggingface.co/ArtusDev/Darkhn_L3.3-70B-Animus-V1-EXL3/tree/4.25bpw_H6) | 4.25 | 6 |
|
19 |
+
| [5.0_H6](https://huggingface.co/ArtusDev/Darkhn_L3.3-70B-Animus-V1-EXL3/tree/5.0bpw_H6) | 5.0 | 6 |
|
20 |
| [6.0_H6](https://huggingface.co/ArtusDev/Darkhn_L3.3-70B-Animus-V1-EXL3/tree/6.0bpw_H6) | 6.0 | 6 |
|
21 |
+
| [8.0_H6](https://huggingface.co/ArtusDev/Darkhn_L3.3-70B-Animus-V1-EXL3/tree/8.0bpw_H6) | 8.0 | 6 |
|
22 |
+
| [8.0_H8](https://huggingface.co/ArtusDev/Darkhn_L3.3-70B-Animus-V1-EXL3/tree/8.0bpw_H8) | 8.0 | 8 |
|
23 |
|
24 |
### Downloading quants with huggingface-cli
|
25 |
|