Hugging Face's logo

second-state
/
Qwen2.5-3B-Instruct-GGUF

Text Generation
GGUF
English
qwen2
chat
conversational
Model card Files Community
1
apepkuss79 commited on
Commit
ca6b5e1
·
verified ·
1 Parent(s): 815db63

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -84,4 +84,4 @@ tags:
84
  | [Qwen2.5-3B-Instruct-Q8_0.gguf](https://huggingface.co/second-state/Qwen2.5-3B-Instruct-GGUF/blob/main/Qwen2.5-3B-Instruct-Q8_0.gguf) | Q8_0 | 8 | 1.65 GB| very large, extremely low quality loss - not recommended |
85
  | [Qwen2.5-3B-Instruct-f16.gguf](https://huggingface.co/second-state/Qwen2.5-3B-Instruct-GGUF/blob/main/Qwen2.5-3B-Instruct-f16.gguf) | f16 | 16 | 3.09 GB| |
86
 
87
- *Quantized with llama.cpp b3751*
 
84
  | [Qwen2.5-3B-Instruct-Q8_0.gguf](https://huggingface.co/second-state/Qwen2.5-3B-Instruct-GGUF/blob/main/Qwen2.5-3B-Instruct-Q8_0.gguf) | Q8_0 | 8 | 1.65 GB| very large, extremely low quality loss - not recommended |
85
  | [Qwen2.5-3B-Instruct-f16.gguf](https://huggingface.co/second-state/Qwen2.5-3B-Instruct-GGUF/blob/main/Qwen2.5-3B-Instruct-f16.gguf) | f16 | 16 | 3.09 GB| |
86
 
87
+ *Quantized with llama.cpp b4466*