Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

6,932

Full-text search

Active filters: chat

numen-tech/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • Updated Dec 2, 2024

numen-tech/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4

Text Generation • Updated Dec 2, 2024

CaioXapelaum/Qwen2.5-1.5B-Instruct-Q4-mlx

Text Generation • 0.2B • Updated Apr 28 • 17

Dracones/Qwen2.5-72B-Instruct_exl2_8.0bpw

Text Generation • Updated Dec 2, 2024 • 2

Dracones/Qwen2.5-72B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 2, 2024 • 2

Dracones/Qwen2.5-72B-Instruct_exl2_6.0bpw

Text Generation • Updated Dec 2, 2024 • 3

Dracones/Qwen2.5-72B-Instruct_exl2_5.0bpw

Text Generation • Updated Dec 2, 2024 • 2

Dracones/Qwen2.5-72B-Instruct_exl2_4.5bpw

Text Generation • Updated Dec 2, 2024 • 2 • 1

Dracones/Qwen2.5-72B-Instruct_exl2_4.0bpw

Text Generation • Updated Dec 2, 2024 • 3

Dracones/Qwen2.5-72B-Instruct_exl2_3.5bpw

Text Generation • Updated Dec 2, 2024 • 2

Dracones/Qwen2.5-72B-Instruct_exl2_3.0bpw

Text Generation • Updated Dec 2, 2024 • 3 • 1

micaebe/Qwen2.5-1.5B-Instruct-QwQ

Text Generation • 2B • Updated Dec 3, 2024 • 3 • 4

mradermacher/EZO-QwQ-32B-Preview-i1-GGUF

33B • Updated Dec 2, 2024 • 37 • 1

Apel-sin/qwq-32b-coder-fusion-9010-exl2

Text Generation • Updated Dec 2, 2024

bullerwins/QwQ-32B-Preview-exl2_4.0bpw

Text Generation • Updated Dec 2, 2024 • 2

bullerwins/QwQ-32B-Preview-exl2_5.0bpw

Text Generation • Updated Dec 2, 2024 • 2

bullerwins/QwQ-32B-Preview-exl2_6.0bpw

Text Generation • Updated Dec 2, 2024 • 2

bullerwins/QwQ-32B-Preview-exl2_8.0bpw

Text Generation • Updated Dec 2, 2024 • 2

mradermacher/QwQ-32B-Coder-Fusion-7030-i1-GGUF

33B • Updated Dec 4, 2024 • 85 • 1

roxy45/QwQ-32B-Preview-Q4_K_M-GGUF

33B • Updated Dec 2, 2024 • 5

mradermacher/Holland-4B-V1-i1-GGUF

5B • Updated Apr 22 • 126

mradermacher/Darkens-8B-GGUF

8B • Updated Dec 3, 2024 • 19 • 2

mradermacher/Baldur-8B-GGUF

8B • Updated Dec 3, 2024 • 59

mradermacher/Tor-8B-GGUF

8B • Updated Dec 3, 2024 • 28

mradermacher/Baldur-8B-i1-GGUF

8B • Updated Dec 3, 2024 • 90

mradermacher/Darkens-8B-i1-GGUF

8B • Updated Dec 3, 2024 • 45 • 1

mradermacher/Tor-8B-i1-GGUF

8B • Updated Dec 3, 2024 • 153

tensorblock/calme-3.2-instruct-3b-GGUF

Text Generation • 3B • Updated Jul 9 • 39

Dracones/QwQ-32B-Preview_exl2_8.0bpw

Text Generation • Updated Dec 3, 2024 • 2

Dracones/QwQ-32B-Preview_exl2_7.0bpw

Text Generation • Updated Dec 3, 2024 • 2