Mungert
/

granite-3.1-1b-a400m-instruct-GGUF

Text Generation

Model card Files Files and versions

granite-3.1-1b-a400m-instruct-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 11 commits

Mungert's picture

Upload granite-3.1-1b-a400m-instruct-q3_k_s.gguf with huggingface_hub

74cae0b verified 21 days ago

.gitattributes

2.31 kB

Upload granite-3.1-1b-a400m-instruct-q3_k_s.gguf with huggingface_hub 21 days ago
granite-3.1-1b-a400m-instruct-bf16_q6_k.gguf

1.2 GB
xet

Upload granite-3.1-1b-a400m-instruct-bf16_q6_k.gguf with huggingface_hub 21 days ago
granite-3.1-1b-a400m-instruct-bf16_q8_0.gguf

1.5 GB
xet

Upload granite-3.1-1b-a400m-instruct-bf16_q8_0.gguf with huggingface_hub 21 days ago
granite-3.1-1b-a400m-instruct-f16.gguf

2.67 GB
xet

Upload granite-3.1-1b-a400m-instruct-f16.gguf with huggingface_hub 21 days ago
granite-3.1-1b-a400m-instruct-f16_q6_k.gguf

1.2 GB
xet

Upload granite-3.1-1b-a400m-instruct-f16_q6_k.gguf with huggingface_hub 21 days ago
granite-3.1-1b-a400m-instruct-f16_q8_0.gguf

1.5 GB
xet

Upload granite-3.1-1b-a400m-instruct-f16_q8_0.gguf with huggingface_hub 21 days ago
granite-3.1-1b-a400m-instruct-q3_k_l.gguf

685 MB
xet

Upload granite-3.1-1b-a400m-instruct-q3_k_l.gguf with huggingface_hub 21 days ago
granite-3.1-1b-a400m-instruct-q3_k_m.gguf

673 MB
xet

Upload granite-3.1-1b-a400m-instruct-q3_k_m.gguf with huggingface_hub 21 days ago
granite-3.1-1b-a400m-instruct-q3_k_s.gguf

626 MB
xet

Upload granite-3.1-1b-a400m-instruct-q3_k_s.gguf with huggingface_hub 21 days ago
granite-3.1-1b-a400m-instruct-q5_k_l.gguf

996 MB
xet

Upload granite-3.1-1b-a400m-instruct-q5_k_l.gguf with huggingface_hub 21 days ago
granite-3.1-1b-a400m-instruct-q6_k_l.gguf

1.11 GB
xet

Upload granite-3.1-1b-a400m-instruct-q6_k_l.gguf with huggingface_hub 21 days ago