Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

3,321

Full-text search

Active filters: exl2

LoneStriker/Mistral-Small-Instruct-2409-8.0bpw-h8-exl2

Updated 2 days ago • 93 • 3

BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_2.7bpw_h6

Text Generation • Updated 12 days ago • 45 • 4

LoneStriker/Mistral-Small-Instruct-2409-4.0bpw-h6-exl2

Updated 2 days ago • 44 • 2

mradermacher/Merged-RP-Stew-V2-34B-i1-GGUF

Updated May 28 • 512 • 22

ParasiticRogue/Instant-RP-Noodles-12B-v1.4-exl2-8.0

Text Generation • Updated 7 days ago • 37 • 2

ParasiticRogue/Magnum-Instruct-DPO-12B-exl2-4.0

Text Generation • Updated 7 days ago • 10 • 2

brucethemoose/Yi-34B-200K-RPMerge

Text Generation • Updated Mar 4 • 90 • 59

LoneStriker/BoreanGale-70B-3.5bpw-h6-exl2

Text Generation • Updated Mar 15 • 9 • 1

lucyknada/ResplendentAI_Aura_Uncensored_l3_8B-6.0bpw-EXL2

Text Generation • Updated Apr 21 • 11 • 2

lucyknada/chargoddard_llama3-42b-v0-4.0bpw-EXL2

Text Generation • Updated Apr 22 • 11 • 4

hjhj3168/Llama-3-8b-Orthogonalized-exl2

Text Generation • Updated May 1 • 48 • 90

LoneStriker/Llama-3-70B-Instruct-Gradient-524k-2.4bpw-h6-exl2

Text Generation • Updated May 4 • 4 • 1

benk04/Typhon-Mixtral-v1-3.75bpw-h6-exl2

Text Generation • Updated Jun 2 • 12 • 3

backyardai/Yi-34B-200K-RPMerge-GGUF

Updated Jul 18 • 307 • 2

bigstorm/Llama-3-Groq-70B-Tool-Use-8.0bpw-8hb-exl2

Text Generation • Updated Jul 18 • 4 • 1

cgus/gemma-2-9b-it-abliterated-exl2

Text Generation • Updated Jul 28 • 98 • 1

ek826/Meta-Llama-3.1-405B-Instruct-6.0bpw-exl2

Text Generation • Updated Aug 4 • 44 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-5.0bpw-h6-exl2

Updated Aug 15 • 6 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-6.0bpw-h6-exl2

Updated Aug 15 • 17 • 1

SicariusSicariiStuff/Dusk_Rainbow-EXL2-8.0-bpw

Updated 9 days ago • 27 • 1

ek826/Meta-Llama-3.1-405B-Instruct-4.25bpw-gqa-exl2

Text Generation • Updated Aug 17 • 7 • 1

drexample/magnum-v2-123b-exl2-5.0bpw

Text Generation • Updated 30 days ago • 23 • 1

gghfez/DarkMage-123b-exl2

Updated 29 days ago • 12 • 1

yiximail/L3.1-70B-Euryale-v2.2-4.65bpw-h6-exl2

Updated 20 days ago • 32 • 1

async0x42/c4ai-command-r-08-2024-exl2_4bpw

Text Generation • Updated 20 days ago • 61 • 1

bullerwins/c4ai-command-r-08-2024-exl2_4.0bpw

Text Generation • Updated 19 days ago • 46 • 1

gghfez/ArliAI-RPMax-12B-v1.1-exl2-8.0bpw

Updated 19 days ago • 19 • 1

gghfez/ArliAI-RPMax-12B-v1.1-exl2-6.0bpw

Updated 19 days ago • 31 • 1

bullerwins/c4ai-command-r-plus-08-2024-exl2_3.5bpw

Text Generation • Updated 18 days ago • 14 • 2

DeusImperator/Star-Command-R-32B-v1_exl2_4.5bpw

Updated 16 days ago • 34 • 1