Mungert
/

granite-3.1-2b-instruct-GGUF

Text Generation

Model card Files Files and versions

granite-3.1-2b-instruct-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 12 commits

Mungert's picture

Upload granite-3.1-2b-instruct-q6_k_l.gguf with huggingface_hub

303fa59 verified 18 days ago

.gitattributes

2.32 kB

Upload granite-3.1-2b-instruct-q6_k_l.gguf with huggingface_hub 18 days ago
granite-3.1-2b-instruct-bf16_q4_k.gguf

2.84 GB
xet

Upload granite-3.1-2b-instruct-bf16_q4_k.gguf with huggingface_hub 18 days ago
granite-3.1-2b-instruct-bf16_q6_k.gguf

3.24 GB
xet

Upload granite-3.1-2b-instruct-bf16_q6_k.gguf with huggingface_hub 18 days ago
granite-3.1-2b-instruct-bf16_q8_0.gguf

3.61 GB
xet

Upload granite-3.1-2b-instruct-bf16_q8_0.gguf with huggingface_hub 18 days ago
granite-3.1-2b-instruct-f16.gguf

5.07 GB
xet

Upload granite-3.1-2b-instruct-f16.gguf with huggingface_hub 18 days ago
granite-3.1-2b-instruct-f16_q4_k.gguf

2.84 GB
xet

Upload granite-3.1-2b-instruct-f16_q4_k.gguf with huggingface_hub 18 days ago
granite-3.1-2b-instruct-f16_q6_k.gguf

3.24 GB
xet

Upload granite-3.1-2b-instruct-f16_q6_k.gguf with huggingface_hub 18 days ago
granite-3.1-2b-instruct-f16_q8_0.gguf

3.61 GB
xet

Upload granite-3.1-2b-instruct-f16_q8_0.gguf with huggingface_hub 18 days ago
granite-3.1-2b-instruct-q3_k_l.gguf

1.27 GB
xet

Upload granite-3.1-2b-instruct-q3_k_l.gguf with huggingface_hub 18 days ago
granite-3.1-2b-instruct-q4_k_l.gguf

1.55 GB
xet

Upload granite-3.1-2b-instruct-q4_k_l.gguf with huggingface_hub 18 days ago
granite-3.1-2b-instruct-q5_k_l.gguf

1.83 GB
xet

Upload granite-3.1-2b-instruct-q5_k_l.gguf with huggingface_hub 18 days ago
granite-3.1-2b-instruct-q6_k_l.gguf

2.1 GB
xet

Upload granite-3.1-2b-instruct-q6_k_l.gguf with huggingface_hub 18 days ago