Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

Inference Endpoints

text-generation-inference

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

115

Full-text search

Active filters: exllamav2

altomek/RE-70B-AS3D-3.75bpw-EXL2

altomek/RE-70B-AS3D-4bpw-EXL2

Updated Jan 29 • 2

altomek/RE-70B-AS3D-3bpw-EXL2

Updated Jan 30 • 5

altomek/RE-70B-AS3D-4.25bpw-EXL2

Updated Jan 30 • 3

TheMelonGod/granite-3.1-8b-instruct-exl2

Text Generation • Updated Feb 5 • 63

altomek/Mistral-Small-24B-Instruct-2501-8bpw-EXL2

Alissonerdx/exllamav2-0.2.7-cu12.8.0.torch2.7.0-cp312-cp312-linux_x86_64

cgus/granite-3.2-8b-instruct-preview-exl2

Text Generation • Updated Feb 9 • 11

cgus/granite-guardian-3.1-8b-exl2

Text Generation • Updated Feb 26 • 19

TheMelonGod/AceInstruct-7B-exl2

Text Generation • Updated Feb 16 • 9

cgus/granite-3.2-2b-instruct-exl2

Text Generation • Updated Feb 26 • 27

cgus/granite-3.2-8b-instruct-exl2

Text Generation • Updated Feb 27 • 13

cgus/granite-guardian-3.2-5b-exl2

Text Generation • Updated Mar 2 • 12

cgus/granite-3.1-8b-Reasoning-exl2

Text Generation • Updated Mar 5 • 12

TheMelonGod/Captain-Eris_Violet-GRPO-v0.420-exl2

Text Generation • Updated Mar 10 • 49

cgus/granite-3.2-8b-instruct-abliterated-exl2

Text Generation • Updated Mar 10 • 19

TheMelonGod/Captain-Eris-BMO_Violent-GRPO-v0.420-exl2

Text Generation • Updated Mar 13 • 67

tokutsu/japanese-answer-13b-8bit

Updated Apr 21 • 3

TheMelonGod/14B-Qwen2.5-Freya-x1-exl2

Text Generation • Updated Mar 16 • 44

TheMelonGod/miscii-14b-0218-exl2

Text Generation • Updated Mar 21 • 70 • 1

cgus/Galactic-Qwen-14B-Exp2-exl2

Text Generation • Updated Mar 18 • 10

cgus/Mistral-Small-3.1-DRAFT-0.5B-exl2

Text Generation • Updated Mar 24 • 18 • 1

TheMelonGod/Qwen2.5-7B-Rebase-exl2

Text Generation • Updated Mar 26 • 18

TheMelonGod/lb-reranker-0.5B-v1.0-exl2

Text Generation • Updated Apr 15

cgus/DeepCoder-14B-Preview-exl2

Text Generation • Updated Apr 10 • 24 • 2

cgus/ZR1-1.5B-exl2

Text Generation • Updated Apr 12 • 8 • 1

cgus/SAINEMO-reMIX-exl2

Updated Apr 14 • 12

cgus/NekoMix-12B-exl2

Updated Apr 14 • 4

cgus/DeepScaleR-1.5B-Preview-exl2

Text Generation • Updated Apr 15 • 14

cgus/DeepCoder-1.5B-Preview-exl2

Text Generation • Updated Apr 15 • 19