Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

3,717

Full-text search

Active filters: exl2

Handgun1773/Qwen2.5-Coder-7B-BASE-8.0bpw-exl2

Text Generation • Updated Oct 4 • 11 • 1

gghfez/zetasepic_Qwen2.5-72B-Instruct-abliterated-exl2-4.5bpw

Text Generation • Updated Oct 7 • 27 • 1

altomek/gemma-2-9b-8bpw-EXL2

Text Generation • Updated Oct 7 • 14 • 1

MikeRoz/TheDrummer_Behemoth-123B-v1-5.0bpw-h6-exl2

Updated Oct 10 • 129 • 3

MikeRoz/TheDrummer_Behemoth-123B-v1-3.5bpw-h6-exl2

Updated about 1 month ago • 24 • 1

zetasepic/Qwen2.5-32B-Instruct-abliterated-v2-6.5bpw-exl2

Text Generation • Updated 29 days ago • 23 • 1

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-8.0bpw-8hb-exl2

Text Generation • Updated 25 days ago • 221 • 3

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-7.0bpw-8hb-exl2

Text Generation • Updated 25 days ago • 27 • 1

schnapper79/lumikabra_behemoth_195B_v2-exl2-2.7bpw

Text Generation • Updated 25 days ago • 13 • 1

schnapper79/lumikabra_behemoth_195B_v2-exl2-5.0bpw

Text Generation • Updated 25 days ago • 45 • 1

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-4.3bpw-6hb-exl2

Text Generation • Updated 25 days ago • 136 • 3

softwareweaver/Twilight-Large-123B-EXL2-5bpw

Text Generation • Updated 24 days ago • 74 • 1

Jellon/Llama-3.1-Saoirse-70B-exl2-3bpw

Text Generation • Updated 18 days ago • 17 • 1

MikeRoz/TheDrummer_Nautilus-70B-v0.1-5.0bpw-h6-exl2

Updated 15 days ago • 16 • 1

denru/Behemoth-123B-v1.1-5_0bpw-h6-exl2-pippa

Updated 14 days ago • 62 • 2

MikeRoz/TheDrummer_Behemoth-123B-v1.1-6.0bpw-h6-exl2

Updated 14 days ago • 30 • 2

MikeRoz/TheDrummer_Behemoth-123B-v1.1-5.0bpw-h6-exl2

Updated 13 days ago • 149 • 3

MikeRoz/TheDrummer_Behemoth-123B-v1.1-4.0bpw-h6-exl2

Updated 13 days ago • 943 • 1

MikeRoz/TheDrummer_Behemoth-123B-v1.1-2.5bpw-h6-exl2

Updated 13 days ago • 29 • 1

BigHuggyD/TheDrummer_Behemoth-123B-v1.1_exl2_5.0bpw_h6

Updated 13 days ago • 44 • 1

BigHuggyD/TheDrummer_Behemoth-123B-v1.1_exl2_8.0bpw_h6

Updated 12 days ago • 40 • 1

async0x42/EVA-Qwen2.5-32B-v0.2-exl2_5.0bpw

Text Generation • Updated 4 days ago • 22 • 1

WaveCut/IlyaGusev-saiga_nemo_12b_sft_m9_d16_simpo_m21_d36-EXL2-8bpw

Updated 3 days ago • 4 • 1

MikeRoz/TheDrummer_Behemoth-123B-v1.1-4.25bpw-h6-exl2

Updated 1 day ago • 3 • 1

ParasiticRogue/Merged-RP-Stew-V2-34B

Text Generation • Updated May 28 • 159 • 49

NeoChen1024/Borealis-10.7B-exl2-6.0bpw-h8

Updated Sep 29 • 4 • 1

icefog72/IceWhiskeyRP-7b-4.2bpw-exl2

Text Generation • Updated Oct 9 • 24 • 1

icefog72/IceWhiskeyRP-7b-8bpw-exl2

Text Generation • Updated Oct 9 • 2.54k • 1

icefog72/IceWhiskeyRP-7b-6.5bpw-exl2

Text Generation • Updated Oct 9 • 27 • 1

Jellon/New-Dawn-Llama-3-70B-32K-v1.0-3bpw

Text Generation • Updated 29 days ago • 18 • 1