Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
SimmonsSongHW
/
Llama-3.2-1B-Instruct-GGUF-Imatrix
like
0
GGUF
imatrix
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
README.md exists but content is empty.
Downloads last month
178
GGUF
Model size
1.24B params
Architecture
llama
Hardware compatibility
Log In
to view the estimation
2-bit
Q2_K
581 MB
3-bit
Q3_K
691 MB
4-bit
Q4_0
773 MB
Q4_K
808 MB
5-bit
Q5_0
895 MB
Q5_K
912 MB
6-bit
Q6_K
1.02 GB
8-bit
Q8_0
1.32 GB
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
HF Inference deployability: The model has no library tag.
Collection including
SimmonsSongHW/Llama-3.2-1B-Instruct-GGUF-Imatrix
Llama3-Quants-Imatrix
Collection
3 items
โข
Updated
17 days ago