Body: <p>Many models specify details using prefixes such as <code>Q6_K</code> or <code>Q4_K_S</code>.</p>
  <p>It seems obvious that the <code>Q</code> portion refers to quantization; what about the other characters?</p>
  <p>Is there a standard nomenclature reference for this?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-01-18T11:01:44.367Z
Comments.Text: Can you please point us to a reference/link/webpage that uses this notation?
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-01-25T21:07:50.080Z
Comments.Text: Just about any huggingface model page, such as this one: https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF
Comments.UserDisplayName: Joshua D. Boyd
Tags: <terminology><models><notation>
Title: Is there a standard nomenclature for model names suffixed by strings such as "Q4_K_S"?
UserDisplayName: Mark Harrison
ThreadText: # Is there a standard nomenclature for model names suffixed by strings such as "Q4_K_S"?
  
  (Asked by: username_0 on 2024-01-17)
  
  Many models specify details using prefixes such as `Q6_K` or `Q4_K_S`.
  
  It seems obvious that the `Q` portion refers to quantization; what about the other characters?
  
  Is there a standard nomenclature reference for this?
  
  **Tags:** terminology, models, notation
  
  > **Comments:**
  > **username_1**: Can you please point us to a reference/link/webpage that uses this notation?  
  > **username_2**: Just about any huggingface model page, such as this one: https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF  
  
  ---
  
  ## 0 answers
  
  