Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

2,219

Full-text search

Active filters: chat

Enfint/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated Sep 5 • 1

byroneverson/Yi-1.5-34B-Chat-abliterated

Text Generation • Updated Sep 14 • 288 • 2

mradermacher/Yi-1.5-9B-Chat-abliterated-GGUF

Updated Sep 5 • 189

wmilesboltz/Qwen2-7B-Instruct-Q2_K-GGUF

Text Generation • Updated Sep 6 • 3

koesn/Hermes-3-Llama-3.1-8B-GGUF

Updated Sep 8 • 129

QuantFactory/leniachat-qwen2-1.5B-v0-GGUF

Updated Sep 7 • 260 • 2

QuantFactory/leniachat-gemma-2b-v0-GGUF

Updated Sep 7 • 355 • 2

jxtngx/Hermes-3-Llama-3.1-8B-Q8_0-GGUF

Updated Sep 7 • 14

jxtngx/Hermes-3-Llama-3.1-8B-Q4_K_M-GGUF

Updated Sep 7 • 2

Quant-Cartel/SorcererLM-8x22b-iMat-GGUF

Text Generation • Updated 11 days ago • 664 • 1

MaziyarPanahi/calme-2.2-llama3.1-70b

Text Generation • Updated Sep 29 • 3.74k • 2

sequelbox/gemma-2-9B-MOTH

Text Generation • Updated Sep 13 • 21

koesn/Llama3.1-8B-Cobalt-GGUF

Text Generation • Updated Sep 10 • 62

antoste/Qwen2-1.5B-Instruct-IQ3_M-GGUF

Text Generation • Updated Sep 11 • 28

antoste/Qwen2-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 10 • 6

antoste/Qwen2-1.5B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Sep 10 • 9

antoste/Qwen2-1.5B-Instruct-IQ4_XS-GGUF

Text Generation • Updated Sep 10 • 25

antoste/Qwen2-1.5B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Sep 11 • 13

MaziyarPanahi/calme-2.3-llama3.1-70b

Text Generation • Updated Sep 29 • 2.54k • 3

TitanML/Qwen2-1.5B-Instruct

Text Generation • Updated Sep 10 • 1

TitanML/Qwen2-0.5B-Instruct

Text Generation • Updated Sep 10 • 1

mradermacher/calme-2.2-llama3.1-70b-GGUF

Updated Sep 11 • 147

koesn/Llama3.1-8B-Enigma-GGUF

Text Generation • Updated Sep 11 • 129

Kondara/Sailor-7B-Chat-Q4_K_M-GGUF

Updated Sep 11 • 4

TitanML/Qwen2-1.5B-Instruct-AWQ

Text Generation • Updated Sep 11 • 3

mradermacher/calme-2.2-llama3.1-70b-i1-GGUF

Updated Sep 12 • 257

TitanML/Qwen2-0.5B-Instruct-AWQ

Text Generation • Updated Sep 11 • 1

TitanML/Qwen2-Math-1.5B

Text Generation • Updated Sep 11 • 9

antoste/Qwen2-7B-Instruct-Q2_K-GGUF

Text Generation • Updated Sep 11 • 2

TitanML/Qwen2-Math-1.5B-Instruct

Text Generation • Updated Sep 11 • 8