Text Generation
GGUF
English
Qwen2.5-Coder-0.5B
conversational

Melvin56/Hammer2.1-0.5b-GGUF

Original Model : MadeAgents/Hammer2.1-0.5b

All quants are made using the imatrix option.

Model Size (GB)
Q2_K_S 0.32
Q2_K 0.33
Q3_K_M 0.35
Q3_K_M 0.35
Q4_0 0.35
Q4_K_M 0.39
Q5_K_M 0.41
Q6_K 0.50
Q8_0 0.52
F16 0.99
Downloads last month
35
GGUF
Model size
494M params
Architecture
qwen2
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Melvin56/Hammer2.1-0.5b-GGUF

Base model

Qwen/Qwen2.5-0.5B
Quantized
(5)
this model

Datasets used to train Melvin56/Hammer2.1-0.5b-GGUF

Collection including Melvin56/Hammer2.1-0.5b-GGUF