DevQuasar
/

ibm-granite.granite-3.1-3b-a800m-base-GGUF

Text Generation

Model card Files Files and versions

'Make knowledge free for everyone'

Quantized version of: ibm-granite/granite-3.1-3b-a800m-base

Downloads last month: 13

GGUF

Model size

3.3B params

Architecture

granitemoe

Hardware compatibility

Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for DevQuasar/ibm-granite.granite-3.1-3b-a800m-base-GGUF

Base model

ibm-granite/granite-3.1-3b-a800m-base

Quantized

(4)

this model

Collection including DevQuasar/ibm-granite.granite-3.1-3b-a800m-base-GGUF

IBM Granite3.1 GGUF

10 items • Updated Dec 18, 2024