Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
granite-3.1-8b-base-GGUF
like
0
Transformers
GGUF
language
granite-3.1
imatrix
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Train
Deploy
Use this model
13c8522
granite-3.1-8b-base-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
25 commits
Mungert
Upload granite-3.1-8b-base-q4_1.gguf with huggingface_hub
13c8522
verified
25 days ago
.gitattributes
3.16 kB
Upload granite-3.1-8b-base-q4_1.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-bf16_q4_k.gguf
Safe
9.11 GB
xet
Upload granite-3.1-8b-base-bf16_q4_k.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-bf16_q6_k.gguf
Safe
10.4 GB
xet
Upload granite-3.1-8b-base-bf16_q6_k.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-bf16_q8_0.gguf
Safe
11.6 GB
xet
Upload granite-3.1-8b-base-bf16_q8_0.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-f16.gguf
Safe
16.3 GB
xet
Upload granite-3.1-8b-base-f16.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-f16_q4_k.gguf
Safe
9.11 GB
xet
Upload granite-3.1-8b-base-f16_q4_k.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-f16_q6_k.gguf
Safe
10.4 GB
xet
Upload granite-3.1-8b-base-f16_q6_k.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-f16_q8_0.gguf
Safe
11.6 GB
xet
Upload granite-3.1-8b-base-f16_q8_0.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q2_k_l.gguf
Safe
3.1 GB
xet
Upload granite-3.1-8b-base-q2_k_l.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q2_k_m.gguf
Safe
3.06 GB
xet
Upload granite-3.1-8b-base-q2_k_m.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q2_k_s.gguf
Safe
3.03 GB
xet
Upload granite-3.1-8b-base-q2_k_s.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q3_k_l.gguf
Safe
4.01 GB
xet
Upload granite-3.1-8b-base-q3_k_l.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q3_k_m.gguf
Safe
3.97 GB
xet
Upload granite-3.1-8b-base-q3_k_m.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q3_k_s.gguf
Safe
3.94 GB
xet
Upload granite-3.1-8b-base-q3_k_s.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q4_0.gguf
4.6 GB
xet
Upload granite-3.1-8b-base-q4_0.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q4_1.gguf
5.11 GB
xet
Upload granite-3.1-8b-base-q4_1.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q4_k_l.gguf
Safe
4.95 GB
xet
Upload granite-3.1-8b-base-q4_k_l.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q4_k_m.gguf
Safe
4.9 GB
xet
Upload granite-3.1-8b-base-q4_k_m.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q4_k_s.gguf
Safe
4.73 GB
xet
Upload granite-3.1-8b-base-q4_k_s.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q5_k_l.gguf
Safe
5.86 GB
xet
Upload granite-3.1-8b-base-q5_k_l.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q5_k_m.gguf
Safe
5.82 GB
xet
Upload granite-3.1-8b-base-q5_k_m.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q5_k_s.gguf
5.73 GB
xet
Upload granite-3.1-8b-base-q5_k_s.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q6_k_l.gguf
Safe
6.75 GB
xet
Upload granite-3.1-8b-base-q6_k_l.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q6_k_m.gguf
6.71 GB
xet
Upload granite-3.1-8b-base-q6_k_m.gguf with huggingface_hub
25 days ago
granite-3.1-8b-base-q8_0.gguf
8.68 GB
xet
Upload granite-3.1-8b-base-q8_0.gguf with huggingface_hub
25 days ago
