<p>Many models specify details using prefixes such as <code>Q6_K</code> or <code>Q4_K_S</code>.</p>
<p>It seems obvious that the <code>Q</code> portion refers to quantization; what about the other characters?</p>
<p>Is there a standard nomenclature reference for this?</p>

CC BY-SA 4.0
2024-01-18T11:01:44.367Z
Can you please point us to a reference/link/webpage that uses this notation?
nbro
CC BY-SA 4.0
2024-01-25T21:07:50.080Z
Just about any huggingface model page, such as this one: https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF
Joshua D. Boyd
<terminology><models><notation>
Is there a standard nomenclature for model names suffixed by strings such as "Q4_K_S"?
Mark Harrison
# Is there a standard nomenclature for model names suffixed by strings such as "Q4_K_S"?

(Asked by: username_0 on 2024-01-17)

Many models specify details using prefixes such as `Q6_K` or `Q4_K_S`.

It seems obvious that the `Q` portion refers to quantization; what about the other characters?

Is there a standard nomenclature reference for this?

**Tags:** terminology, models, notation

> **Comments:**
> **username_1**: Can you please point us to a reference/link/webpage that uses this notation?  
> **username_2**: Just about any huggingface model page, such as this one: https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF  

---

## 0 answers

