Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

2,261

Full-text search

Active filters: chat

bigstorm/Hermes-3-Llama-3.1-70B-7.0bpw-8hb-exl2

bigstorm/Hermes-3-Llama-3.1-70B-8.0bpw-8hb-exl2

Updated Aug 26 • 1

Delta-Vector/Holland-4B-V1

Updated Sep 25 • 16 • 1

HEleven1/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 26 • 1

Delta-Vector/Holland-4B-EXL2

Delta-Vector/Holland-4B-GGUF

Updated Sep 15 • 82

FuturisticVibes/magnum-v2-72b-8.0bpw-h8-exl2

Text Generation • Updated Aug 26 • 13

Infermatic/magnum-v2-72b-FP8-Dynamic

Text Generation • Updated Aug 27 • 508 • 1

chaoxiao/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 27 • 4

chaoxiao/Qwen2-1.5B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Aug 27 • 1

altomek/magnum-v3-34b-8bpw-EXL2

Text Generation • Updated Aug 30 • 9

bartowski/magnum-v2-4b-GGUF

Text Generation • Updated Aug 27 • 849 • 4

djuna/magnum-v2-32b-chatml

Text Generation • Updated Aug 27 • 5

FuturisticVibes/magnum-v1-72b-8.0bpw-h8-exl2

Text Generation • Updated Aug 28 • 1

leafspark/magnum-v2-123b-fp8-dynamic

Text Generation • Updated Aug 30 • 441 • 2

QuantFactory/Llama3.1-8B-Fireplace2-GGUF

Text Generation • Updated Aug 28 • 135 • 1

QuantFactory/Llama3.1-8B-Cobalt-GGUF

Text Generation • Updated Aug 28 • 337 • 1

QuantFactory/Llama3.1-8B-ShiningValiant2-GGUF

Text Generation • Updated Aug 28 • 247 • 1

hellork/calme-2.1-qwen2-7b-IQ4_NL-GGUF

Text Generation • Updated Sep 17 • 20

lucyknada/Luni_StarDust-12b-v1-exl2

Text Generation • Updated Aug 29

backyardai/Hermes-3-Llama-3.1-8B-GGUF

Updated Aug 29 • 399 • 1

Ffftdtd5dtft/Qwen2-7B-Instruct-Q2_K-GGUF

Text Generation • Updated Aug 29 • 200 • 1

Ffftdtd5dtft/Qwen2-1.5B-Instruct-Q2_K-GGUF

Text Generation • Updated Aug 29 • 311

backyardai/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 30 • 436 • 1

mradermacher/StarDust-12b-v1-GGUF

Updated Aug 31 • 231 • 1

mradermacher/StarDust-12b-v1-i1-GGUF

Updated Aug 31 • 102 • 2

Ffftdtd5dtft/Qwen2-Math-72B-Instruct-Q2_K-GGUF

Text Generation • Updated Aug 31 • 7

Ffftdtd5dtft/Qwen2-Math-7B-Instruct-Q2_K-GGUF

Text Generation • Updated Aug 31 • 78

Triangle104/magnum-v2-4b-Q4_K_M-GGUF

Text Generation • Updated Aug 31 • 8

Triangle104/magnum-v2-4b-Q5_K_M-GGUF

Text Generation • Updated Aug 31 • 5