File size: 829 Bytes
b3f5cf3 b3c1f7d b3f5cf3 145554a e29d7c8 8a4451f 145554a a09e84a b3f994d 145554a 8a4451f fbf35f6 7bf819e 8a4451f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 |
---
license: cc-by-4.0
library_name: transformers
tags:
- supertrainer2000
- not-for-all-audiences
- writing
- roleplay
- gguf
- stablelm_epoch
- gguf-imatrix
base_model:
- euclaise/Memphis-scribe-3B
model_type: stablelm_epoch
quantized_by: Green-Sky
language:
- en
---
llama.cpp conversion of https://huggingface.co/euclaise/Memphis-scribe-3B
except for f16 and q8_0, every quant is using the imatrix from wiki-train
### ppl (512 wiki.test)
| quant | ppl (lower is better) |
|---------------|-----|
| f16(baseline) | 9.9437 +/- 0.07019 |
| q8_0 | 9.9474 +/- 0.07022 |
| q5_k_m | 10.0347 +/- 0.07091 |
| q4_k_m | 10.1192 +/- 0.07152 |
| iq3_xxs | 11.5266 +/- 0.08157 |
| q2_k | 13.0623 +/- 0.09548 |
| iq2_xs | 16.6174 +/- 0.11807 |
| iq2_xxs | 22.6462 +/- 0.16226 | |