Ctrl+K

1 contributor

History: 44 commits

Mungert

Upload granite-3.1-8b-base-bf16.gguf with huggingface_hub

8f9eaff verified 23 days ago

.gitattributes

4.37 kB

Upload granite-3.1-8b-base-bf16.gguf with huggingface_hub 23 days ago
README.md

25.3 kB

Upload README.md with huggingface_hub 23 days ago
granite-3.1-8b-base-bf16.gguf

16.3 GB
xet

Upload granite-3.1-8b-base-bf16.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-bf16_q4_k.gguf

9.11 GB
xet

Upload granite-3.1-8b-base-bf16_q4_k.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-bf16_q6_k.gguf

10.4 GB
xet

Upload granite-3.1-8b-base-bf16_q6_k.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-bf16_q8_0.gguf

11.6 GB
xet

Upload granite-3.1-8b-base-bf16_q8_0.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-f16.gguf

16.3 GB
xet

Upload granite-3.1-8b-base-f16.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-f16_q4_k.gguf

9.11 GB
xet

Upload granite-3.1-8b-base-f16_q4_k.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-f16_q6_k.gguf

10.4 GB
xet

Upload granite-3.1-8b-base-f16_q6_k.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-f16_q8_0.gguf

11.6 GB
xet

Upload granite-3.1-8b-base-f16_q8_0.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-iq2_m.gguf

2.94 GB
xet

Upload granite-3.1-8b-base-iq2_m.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-iq2_s.gguf

2.79 GB
xet

Upload granite-3.1-8b-base-iq2_s.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-iq2_xs.gguf

2.69 GB
xet

Upload granite-3.1-8b-base-iq2_xs.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-iq2_xxs.gguf

2.46 GB
xet

Upload granite-3.1-8b-base-iq2_xxs.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-iq3_m.gguf

3.82 GB
xet

Upload granite-3.1-8b-base-iq3_m.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-iq3_s.gguf

3.82 GB
xet

Upload granite-3.1-8b-base-iq3_s.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-iq3_xs.gguf

3.42 GB
xet

Upload granite-3.1-8b-base-iq3_xs.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-iq3_xxs.gguf

3.32 GB
xet

Upload granite-3.1-8b-base-iq3_xxs.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-iq4_nl.gguf

4.67 GB
xet

Upload granite-3.1-8b-base-iq4_nl.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-iq4_xs.gguf

4.43 GB
xet

Upload granite-3.1-8b-base-iq4_xs.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q2_k_l.gguf

3.1 GB
xet

Upload granite-3.1-8b-base-q2_k_l.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q2_k_m.gguf

3.06 GB
xet

Upload granite-3.1-8b-base-q2_k_m.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q2_k_s.gguf

3.03 GB
xet

Upload granite-3.1-8b-base-q2_k_s.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q3_k_l.gguf

4.01 GB
xet

Upload granite-3.1-8b-base-q3_k_l.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q3_k_m.gguf

3.97 GB
xet

Upload granite-3.1-8b-base-q3_k_m.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q3_k_s.gguf

3.94 GB
xet

Upload granite-3.1-8b-base-q3_k_s.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q4_0.gguf

4.6 GB
xet

Upload granite-3.1-8b-base-q4_0.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q4_0_l.gguf

4.7 GB
xet

Upload granite-3.1-8b-base-q4_0_l.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q4_1.gguf

5.11 GB
xet

Upload granite-3.1-8b-base-q4_1.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q4_1_l.gguf

5.2 GB
xet

Upload granite-3.1-8b-base-q4_1_l.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q4_k_l.gguf

4.95 GB
xet

Upload granite-3.1-8b-base-q4_k_l.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q4_k_m.gguf

4.9 GB
xet

Upload granite-3.1-8b-base-q4_k_m.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q4_k_s.gguf

4.73 GB
xet

Upload granite-3.1-8b-base-q4_k_s.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q5_0.gguf

5.62 GB
xet

Upload granite-3.1-8b-base-q5_0.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q5_0_l.gguf

5.7 GB
xet

Upload granite-3.1-8b-base-q5_0_l.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q5_1.gguf

6.13 GB
xet

Upload granite-3.1-8b-base-q5_1.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q5_1_l.gguf

6.19 GB
xet

Upload granite-3.1-8b-base-q5_1_l.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q5_k_l.gguf

5.86 GB
xet

Upload granite-3.1-8b-base-q5_k_l.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q5_k_m.gguf

5.82 GB
xet

Upload granite-3.1-8b-base-q5_k_m.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q5_k_s.gguf

5.73 GB
xet

Upload granite-3.1-8b-base-q5_k_s.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q6_k_l.gguf

6.75 GB
xet

Upload granite-3.1-8b-base-q6_k_l.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q6_k_m.gguf

6.71 GB
xet

Upload granite-3.1-8b-base-q6_k_m.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base-q8_0.gguf

8.68 GB
xet

Upload granite-3.1-8b-base-q8_0.gguf with huggingface_hub 23 days ago
granite-3.1-8b-base.imatrix

5.99 MB
xet

Upload granite-3.1-8b-base.imatrix with huggingface_hub 23 days ago