Add IQ5_K 6BPW with similar PPL as Q8_0
Browse files
README.md
CHANGED
|
@@ -37,6 +37,20 @@ These first two are just test quants for baseline perplexity comparison:
|
|
| 37 |
* `Q8_0` 109.381 GiB (8.505 BPW)
|
| 38 |
- Final estimate: PPL = 4.5798 +/- 0.02804
|
| 39 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 40 |
## IQ4_KSS 54.801 GiB (4.261 BPW)
|
| 41 |
Final estimate: PPL = 4.7056 +/- 0.02909
|
| 42 |
|
|
|
|
| 37 |
* `Q8_0` 109.381 GiB (8.505 BPW)
|
| 38 |
- Final estimate: PPL = 4.5798 +/- 0.02804
|
| 39 |
|
| 40 |
+
## IQ5_K 77.704 GiB (6.042 BPW)
|
| 41 |
+
Final estimate: PPL = 4.5867 +/- 0.02806
|
| 42 |
+
|
| 43 |
+
<details>
|
| 44 |
+
|
| 45 |
+
<summary>👈 Secret Recipe</summary>
|
| 46 |
+
|
| 47 |
+
```bash
|
| 48 |
+
echo TODO
|
| 49 |
+
```
|
| 50 |
+
|
| 51 |
+
</summary>
|
| 52 |
+
|
| 53 |
+
|
| 54 |
## IQ4_KSS 54.801 GiB (4.261 BPW)
|
| 55 |
Final estimate: PPL = 4.7056 +/- 0.02909
|
| 56 |
|