Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

2,271

Full-text search

Active filters: chat

WallStarer/magnum-v2-123b_Exl2_3.5bpw

Text Generation • Updated Aug 21 • 11

Nekuromento/ghost-8b-beta-1608-Q6_K-GGUF

Text Generation • Updated Aug 20 • 9

objects76/qwen2-xlam

Text Generation • Updated Aug 21 • 11

drexample/magnum-v2-123b-exl2-5.0bpw

Text Generation • Updated Aug 21 • 7 • 1

QuantFactory/magnum-v2.5-12b-kto-GGUF

Text Generation • Updated Aug 21 • 118 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_3.0bpw_h6

Text Generation • Updated Aug 21 • 6 • 1

WallStarer/magnum-v2-123b_Exl2_4.25bpw

Text Generation • Updated Aug 21 • 10

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_3.5bpw_h6

Text Generation • Updated Aug 21 • 8 • 1

drexample/magnum-v2-123b-exl2-5.6bpw

Text Generation • Updated Aug 21 • 98

thibaud/Hermes-3-Llama-3.1-70B-FP8-v0

Updated Aug 21 • 2

NikolayKozloff/ghost-8b-beta-1608-Q8_0-GGUF

Text Generation • Updated Aug 21 • 8 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_4.0bpw_h6

Text Generation • Updated Aug 21 • 4

WallStarer/magnum-v2-123b_Exl2_3.75bpw

Text Generation • Updated Aug 21 • 7

mradermacher/magnum-v2-72b-GGUF

Updated Sep 8 • 390 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_5.0bpw_h6

Text Generation • Updated Aug 22 • 15

bartowski/magnum-v2-123b-GGUF

Text Generation • Updated Aug 22 • 1.85k • 1

psyche/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 22 • 62

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_5.5bpw_h6

Text Generation • Updated Aug 22 • 2

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_6.0bpw_h6

Text Generation • Updated Aug 22 • 2

bigstorm/Hermes-3-Llama-3.1-70B-6.5bpw-8hb-exl2

Updated Aug 22 • 2

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_6.5bpw_h8

Text Generation • Updated Aug 22 • 2

hellork/CodeQwen1.5-7B-Chat-IQ4_NL-GGUF

Text Generation • Updated Sep 17 • 16

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_7.0bpw_h8

Text Generation • Updated Aug 22 • 1

GPT4All-Community/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Sep 5 • 37

QuantFactory/ghost-8b-beta-1608-GGUF

Text Generation • Updated Aug 23 • 231 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_7.5bpw_h8

Text Generation • Updated Aug 23 • 1

QuantFactory/ghost-7b-alpha-GGUF

Text Generation • Updated Aug 23 • 77 • 2

MaziyarPanahi/calme-2.1-phi3.5-4b

Text Generation • Updated Sep 4 • 688 • 3

ghost-x/ghost-8b-beta-1608-mlx

Text Generation • Updated Aug 23 • 10

bartowski/calme-2.1-phi3.5-4b-GGUF

Text Generation • Updated Aug 23 • 935 • 2