Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

2,069

Full-text search

Active filters: chat

anthracite-org/magnum-v2.5-12b-kto-gguf

Text Generation • Updated Aug 22 • 5.45k • 33

hellork/calme-2.1-qwen2-7b-Q4_K_M-GGUF

Text Generation • Updated Sep 17 • 17 • 1

bartowski/Hermes-3-Llama-3.1-8B-GGUF

Text Generation • Updated Aug 16 • 2.43k • 4

bartowski/Hermes-3-Llama-3.1-70B-GGUF

Text Generation • Updated Aug 20 • 1.51k • 7

mradermacher/Hermes-3-Llama-3.1-8B-GGUF

Updated Aug 16 • 526 • 2

mradermacher/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 16 • 524 • 1

bartowski/Llama3.1-8B-Enigma-GGUF

Text Generation • Updated Aug 16 • 551 • 1

mlx-community/Hermes-3-Llama-3.1-8B-8bit

Updated Aug 16 • 17 • 2

mlx-community/Hermes-3-Llama-3.1-70B-4bit

Updated Aug 16 • 130 • 1

anthracite-org/magnum-v2-123b

Text Generation • Updated Sep 12 • 853 • 56

XelotX/Hermes-3-Llama-3.1-405B-FP8

Updated Aug 17 • 19 • 1

bartowski/Hermes-3-Llama-3.1-405B-GGUF

Text Generation • Updated Sep 27 • 2.23k • 10

ghost-x/ghost-8b-beta-1608

Text Generation • Updated Aug 23 • 5.78k • 28

anthracite-org/magnum-v2-72b

Text Generation • Updated 29 days ago • 3.06k • 32

anthracite-org/magnum-v2-123b-gguf

Text Generation • Updated Aug 22 • 887 • 12

anthracite-org/magnum-v2-123b-exl2

Text Generation • Updated Aug 19 • 60 • 3

anthracite-org/magnum-v2-72b-exl2

Text Generation • Updated Aug 22 • 47 • 3

mradermacher/magnum-v2-123b-GGUF

Updated Sep 8 • 42 • 5

mradermacher/magnum-v2-123b-i1-GGUF

Updated Sep 8 • 202 • 6

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_2.5bpw_h6

Text Generation • Updated Aug 21 • 4 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_4.5bpw_h6

Text Generation • Updated Aug 21 • 10 • 1

mradermacher/magnum-v2-72b-i1-GGUF

Updated Sep 8 • 757 • 3

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_8.0bpw_h8

Text Generation • Updated Aug 23 • 146 • 2

anthracite-org/magnum-v2-4b

Text Generation • Updated Aug 27 • 427 • 18

byroneverson/glm-4-9b-chat-abliterated

Text Generation • Updated Sep 2 • 95 • 13

Triangle104/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 24 • 18 • 1

genevera/glm-4-9b-chat-abliterated-Q6_K-GGUF

Text Generation • Updated Aug 26 • 21 • 1

byroneverson/gemma-2-27b-it-abliterated

Text Generation • Updated Sep 14 • 2.52k • 16

Luni/StarDust-12b-v1

Text Generation • Updated Sep 5 • 28 • 13

bartowski/glm-4-9b-chat-abliterated-GGUF

Text Generation • Updated Aug 30 • 756 • 4