Edit Models filters

Inference status

Misc

AutoTrain Compatible

Inference Endpoints

Misc with no match

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

80

Full-text search

Active filters: granite-3.0

QuantFactory/granite-3.0-8b-instruct-GGUF

Text Generation • Updated Oct 21 • 3.84k • 2

QuantFactory/granite-3.0-2b-base-GGUF

Text Generation • Updated Oct 21 • 231 • 2

QuantFactory/granite-3.0-3b-a800m-base-GGUF

Text Generation • Updated Oct 21 • 133 • 2

ibm-granite/granite-3.0-2b-instruct

Text Generation • Updated 6 days ago • 27.3k • 46

ibm-granite/granite-3.0-8b-instruct

Text Generation • Updated 6 days ago • 51.5k • 196

ibm-granite/granite-3.0-3b-a800m-instruct

Text Generation • Updated 6 days ago • 3.96k • 17

bartowski/granite-3.0-8b-instruct-GGUF

Text Generation • Updated Oct 21 • 9.2k • 11

lmstudio-community/granite-3.0-8b-instruct-GGUF

Text Generation • Updated Oct 21 • 562 • 1

bartowski/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Oct 21 • 437 • 5

lmstudio-community/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Oct 21 • 53 • 1

bartowski/granite-3.0-1b-a400m-instruct-GGUF

Text Generation • Updated Oct 21 • 690 • 4

bartowski/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • Updated Oct 21 • 3.09k • 1

lmstudio-community/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • Updated Oct 21 • 179 • 1

QuantFactory/granite-3.0-1b-a400m-instruct-GGUF

Text Generation • Updated Oct 23 • 437 • 4

aashish1904/granite-3.0-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 16 • 1

aashish1904/granite-3.0-8b-instruct-Q2_K-GGUF

Text Generation • Updated Oct 21 • 11 • 1

aashish1904/granite-3.0-8b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 6 • 1

aashish1904/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 5 • 1

NikolayKozloff/granite-3.0-8b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 1 • 1

aashish1904/granite-3.0-2b-instruct-Q2_K-GGUF

Text Generation • Updated Oct 21 • 6 • 1

aashish1904/granite-3.0-2b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 4 • 1

QuantFactory/granite-3.0-1b-a400m-base-GGUF

Text Generation • Updated Oct 21 • 215 • 3

QuantFactory/granite-3.0-8b-base-GGUF

Text Generation • Updated Oct 22 • 323 • 2

osllmai-community/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Oct 28 • 92 • 1

tensorblock/granite-3.0-2b-base-GGUF

Text Generation • Updated about 1 month ago • 275 • 1

tensorblock/granite-3.0-3b-a800m-base-GGUF

Text Generation • Updated 29 days ago • 297 • 1

ibm-granite/granite-3.0-2b-base

Text Generation • Updated 6 days ago • 8.95k • 19

ibm-granite/granite-3.0-8b-base

Text Generation • Updated 6 days ago • 9.53k • 22

ibm-granite/granite-3.0-3b-a800m-base

Text Generation • Updated 6 days ago • 2.94k • 4

ibm-granite/granite-3.0-1b-a400m-base

Text Generation • Updated 6 days ago • 3.49k • 5