mradermacher
/

Llama-3.1-Minitron-4B-Depth-Neo-10w-GGUF

Model card Files Files and versions

Llama-3.1-Minitron-4B-Depth-Neo-10w-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

mradermacher's picture

uploaded from marco

c009b90 verified 3 months ago

.gitattributes

2.52 kB

uploaded from marco 3 months ago
Llama-3.1-Minitron-4B-Depth-Neo-10w.IQ4_XS.gguf

2.6 GB
xet

uploaded from marco 3 months ago
Llama-3.1-Minitron-4B-Depth-Neo-10w.Q2_K.gguf

1.9 GB
xet

uploaded from marco 3 months ago
Llama-3.1-Minitron-4B-Depth-Neo-10w.Q3_K_L.gguf

2.49 GB
xet

uploaded from marco 3 months ago
Llama-3.1-Minitron-4B-Depth-Neo-10w.Q3_K_M.gguf

2.34 GB
xet

uploaded from marco 3 months ago
Llama-3.1-Minitron-4B-Depth-Neo-10w.Q3_K_S.gguf

2.16 GB
xet

uploaded from marco 3 months ago
Llama-3.1-Minitron-4B-Depth-Neo-10w.Q4_K_M.gguf

2.83 GB
xet

uploaded from marco 3 months ago
Llama-3.1-Minitron-4B-Depth-Neo-10w.Q4_K_S.gguf

2.71 GB
xet

uploaded from marco 3 months ago
Llama-3.1-Minitron-4B-Depth-Neo-10w.Q5_K_M.gguf

3.27 GB
xet

uploaded from marco 3 months ago
Llama-3.1-Minitron-4B-Depth-Neo-10w.Q5_K_S.gguf

3.2 GB
xet

uploaded from marco 3 months ago
Llama-3.1-Minitron-4B-Depth-Neo-10w.Q6_K.gguf

3.73 GB
xet

uploaded from marco 3 months ago
Llama-3.1-Minitron-4B-Depth-Neo-10w.Q8_0.gguf

4.83 GB
xet

uploaded from marco 3 months ago
Llama-3.1-Minitron-4B-Depth-Neo-10w.f16.gguf

9.09 GB
xet

uploaded from marco 3 months ago
README.md

238 Bytes

uploaded from marco 3 months ago