Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,843

Full-text search

Active filters: llama-cpp

Tesslate/OmniCoder-9B-GGUF

9B • Updated 4 days ago • 21.5k • 92

LocoreMind/LocoOperator-4B

Text Generation • 4B • Updated 20 days ago • 17.1k • 288

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 631 • 147

jinaai/jina-embeddings-v5-text-small-text-matching

Sentence Similarity • 0.6B • Updated 14 days ago • 16.3k • 10

ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF

Text Generation • 2B • Updated Oct 28, 2024 • 5.62k • 17

itlwas/Qwen2.5-Coder-7B-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 20, 2024 • 6.18k • 3

jinaai/jina-embeddings-v5-text-small-retrieval

Sentence Similarity • 0.6B • Updated 14 days ago • 162k • 16

jwest33/qwen3.5-9b-null-space-abliterated-GGUF

9B • Updated 13 days ago • 21.4k • 17

jwest33/qwen3.5-4b-gabliterated-GGUF

4B • Updated 7 days ago • 1.56k • 4

Abhiray/Qwen3.5-9B-Abliterated-Claude-4.6-Opus-Reasoning-Distilled-GGUF

9B • Updated 7 days ago • 1.11k • 3

ggml-org/bge-small-en-v1.5-Q8_0-GGUF

Feature Extraction • 33.2M • Updated Feb 6, 2025 • 553 • 6

ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF

Text Ranking • 0.6B • Updated Oct 3, 2025 • 30.9k • 8

ruv/ruvltra-claude-code

Text Generation • 0.5B • Updated Jan 20 • 10.4k • 139

jinaai/jina-embeddings-v5-text-small-retrieval-GGUF

Sentence Similarity • 0.6B • Updated 19 days ago • 6.98k • 6

TitleOS/Qwen3-VL-Embedding-2B-GGUF

Feature Extraction • 0.4B • Updated 25 days ago • 308 • 2

HeYujie/Qwen3.5-35B-A3B-abliterated-GGUF

Image-Text-to-Text • 35B • Updated 11 days ago • 5.96k • 9

0Time/INCEPT-SH

0.8B • Updated 7 days ago • 23 • 2

Jongsim/Qwen3.5-35B-A3B-heretic-Opus-4.6-Distilled-GGUF

Text Generation • Updated 2 days ago • 384 • 2

Tech-Meld/HX-Mistral-3B_v0.1-Q4_K_M-GGUF

4B • Updated Apr 9, 2024 • 41 • 1

gate369/Bitnet-M7-70m-Q8_0-GGUF

77.5M • Updated Apr 15, 2024 • 24 • 2

Anoxiom/Sujet-Finance-8B-v0.1-Q6_K-GGUF

Text Generation • 8B • Updated Apr 23, 2024 • 16 • 2

SansarK/Mistral-3B-Instruct-v0.2-Q2_K-GGUF

3B • Updated Jun 1, 2024 • 54 • 1

Ransss/Pantheon-RP-1.5-12b-Nemo-Q8_0-GGUF

12B • Updated Aug 4, 2024 • 4 • 1

RinaChen/nomic-embed-text-v1.5-Q4_K_M-GGUF

Sentence Similarity • 0.1B • Updated Aug 5, 2024 • 116 • 1

WSDW/Qwen2.5-7B-Instruct-Uncensored-Q4_K_M-GGUF

Text Generation • 8B • Updated Oct 6, 2024 • 7.92k • 2

noxinc/bitnet_b1_58-large-Q5_K_M-GGUF

0.7B • Updated Oct 20, 2024 • 34 • 1

JackeyLai/Qwen2.5-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 11, 2024 • 332 • 1

yemiao2745/Qwen2.5-14B-Instruct-Uncensored-Q4_K_M-GGUF

15B • Updated Nov 23, 2024 • 1.24k • 5

gurro/nano-mistral-Q4_K_M-GGUF

0.2B • Updated Nov 30, 2024 • 8 • 2

matrixportalx/Llama-3.2-3B-Instruct-uncensored-Q3_K_M-GGUF

4B • Updated Dec 3, 2024 • 121 • 1