Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

5,842

Full-text search

Active filters: exl2

hjhj3168/Llama-3-8b-Orthogonalized-exl2

Text Generation • Updated May 1, 2024 • 9 • 91

Statuo/NemoMix-Unleashed-EXL2-8bpw

Text Generation • Updated Aug 23, 2024 • 106 • 5

FluffyKaeloky/Luminum-v0.1-123B-exl2-4.0bpw

Text Generation • Updated Aug 29, 2024 • 31 • 1

BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_4.0bpw_h6

Text Generation • Updated Sep 7, 2024 • 20 • 1

riveRiPH/MN-12B-Lyra-v4-6bpw-h8-exl2

Updated Sep 9, 2024 • 11 • 3

MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-6.0bpw-h6-exl2

Updated Sep 26, 2024 • 83 • 26

MarsupialAI/Monstral-123B_4.0bpw_EXL2

Text Generation • Updated Oct 25, 2024 • 15 • 1

DBMe/EVA-Qwen2.5-72B-v0.0-4.86bpw-h6-exl2

Text Generation • Updated Oct 30, 2024 • 15 • 1

openerotica/Mistral-Small-Instruct-2409-abliterated-4.5bpw-exl2

Text Generation • Updated Nov 11, 2024 • 34 • 2

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated Apr 4 • 113

waldie/Cydonia-22B-v1.3-5.5bpw-h6-exl2

Updated Nov 19, 2024 • 3 • 1

BigHuggyD/MarsupialAI_Monstral-123B_exl2_4.0bpw_h6

Text Generation • Updated Nov 23, 2024 • 16 • 1

FluffyKaeloky/Monstral-123B-v2-exl2-4.0bpw

Text Generation • Updated Dec 10, 2024 • 41 • 1

FluffyKaeloky/L3.3-70B-Euryale-v2.3-exl2-6.0bpw

Text Generation • Updated Dec 11, 2024 • 11 • 1

pipilok/phi-4-exl2-6.5bpw-hb8

Updated Dec 14, 2024 • 6 • 1

pipilok/phi-4-unsloth-exl2-8bpw-hb8

Updated Jan 9 • 2 • 1

DavidCatalano/calme-3.2-instruct-78b-exl2

Text Generation • Updated Jan 21 • 26 • 6

Darkhn/L3.3-MS-Nevoria-6.0bpw-h8-exl2

Text Generation • Updated Jan 19 • 24 • 2

waldie/DeepSeek-R1-Distill-Qwen-32B-4bpw-h6-exl2

Updated Jan 20 • 17 • 7

MikeRoz/deepseek-ai_DeepSeek-R1-Distill-Llama-70B-4.25bpw-h6-exl2

Updated Jan 20 • 10 • 5

riveRiPH/Wayfarer_Eris_Noctis-12B-6bpw-h8-exl2

Text Generation • Updated Jan 25 • 7 • 1

VoidStare/L3.3-MS-Nevoria-70b-EXL2-6.5bpw-h8

Text Generation • Updated Jan 27 • 10 • 1

matatonic/Mistral-Small-24B-Instruct-2501-4.0bpw-exl2

Text Generation • Updated Jan 30 • 7 • 1

ordis-co-ltd/Qwen2.5-VL-72B-Instruct_exl2_6.0bpw

Image-Text-to-Text • Updated Feb 10 • 10 • 2

sleepdeprived3/Reformed-Christian-Bible-Expert-12B_EXL2_5bpw_H8

Text Generation • Updated Apr 12 • 19 • 1

riveRiPH/Captain-Eris_Violet-GRPO-v0.420-6bpw-h8-exl2

Text Generation • Updated Feb 19 • 16 • 1

Dracones/QwQ-32B_exl2_4.0bpw

Text Generation • Updated Mar 6 • 10 • 1

matatonic/QwQ-32B-abliterated-4.25bpw-exl2

Text Generation • Updated Mar 7 • 14 • 4

LoneStriker/YiXin-Distill-Qwen-72B-4.5bpw-h6-exl2

Text Generation • Updated Mar 15 • 16 • 4

ReadyArt/Pantheon-RP-1.8-24b-Small-3.1_EXL2_4.0bpw_H8

Updated Mar 22 • 28 • 1