Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3.2-3B-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Model card
Files
Files and versions
Community
1
Use this model
refs/pr/1
Llama-3.2-3B-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
7 commits
MaziyarPanahi
d6cd09281ffb8133fe36b8adf4a780dc33f84c74455a1b69e99acdd9273520a4
96c4992
verified
7 months ago
.gitattributes
Safe
1.88 kB
d6cd09281ffb8133fe36b8adf4a780dc33f84c74455a1b69e99acdd9273520a4
7 months ago
Llama-3.2-3B-GGUF_imatrix.dat
2.99 MB
LFS
d6cd09281ffb8133fe36b8adf4a780dc33f84c74455a1b69e99acdd9273520a4
7 months ago
Llama-3.2-3B.Q5_K_M.gguf
Safe
2.32 GB
LFS
2932c14f9fe18e273c51fc9aaccfb6acf302a9093e2aea37bf6e26fd73fcf7cc
7 months ago
Llama-3.2-3B.Q5_K_S.gguf
Safe
2.27 GB
LFS
ce27b2ddf0efd46e5e5aa7b68b937baf3ffb294abc66873d7a73c4e49cbac108
7 months ago
Llama-3.2-3B.Q6_K.gguf
Safe
2.64 GB
LFS
a28c4e1d1d6878db3854fcad40c7d50623824556a579b41180b8d355c6e8b5c5
7 months ago
Llama-3.2-3B.Q8_0.gguf
Safe
3.42 GB
LFS
d9e9e93e1e46b8ec2369b399379691d3a0171e91ce12b620972202c5dd868c56
7 months ago
Llama-3.2-3B.fp16.gguf
Safe
6.43 GB
LFS
cab83ba02472733a4bf82962e92078d5b6090e5932cba8947bcdb946eeae8f7b
7 months ago
README.md
Safe
2.91 kB
d6cd09281ffb8133fe36b8adf4a780dc33f84c74455a1b69e99acdd9273520a4
7 months ago
