Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,820

Base only

Active filters: llama-cpp

WhiskyAKM/Ling-3.0-flash-GGUF

Text Generation • 127B • Updated 9 days ago • 430 • 2

Hikari07jp/Maple-Preview-TQ2-Abliterated

Text Generation • 20B • Updated 8 days ago • 2.07k • 5

shafire/OpenZero-Gemma4-E2B-Agentic-GGUF

Text Generation • 5B • Updated 5 days ago • 504 • 3

WhiskyAKM/Ling-3.0-Tiny-GGUF

Text Generation • 8B • Updated 5 days ago • 1.3k • 2

shafire/OpenZero-Ministral3-8B-Runtime-Agent-GGUF

Text Generation • 8B • Updated about 9 hours ago • 125 • 2

prithivMLmods/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16-GGUF

Text Generation • 33B • Updated 4 days ago • 430 • 2

NikDowse/Qwen3.8-27B-Q6_K-GGUF

Image-Text-to-Text • 27B • Updated 1 day ago • 157 • 2

wago666/Qwen3.8-27B-heretic-ara-Q5_K_M-GGUF

Image-Text-to-Text • 27B • Updated 1 day ago • 566 • 2

douyamv/Qwen3.8-27B-GGUF

Text Generation • Updated about 14 hours ago • 114 • 2

NikolayKozloff/llama-3-llamilitary-Q8_0-GGUF

8B • Updated Jul 4, 2024 • 57 • 4

rktmeister/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Aug 17, 2024 • 52 • 1

paultimothymooney/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 18, 2024 • 9.43k • 7

Hugggme/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Sep 18, 2024 • 70 • 3

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 25.5k • 38

Kondara/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 28, 2024 • 1.42k • 3

Orion-zhen/Meissa-Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Sep 30, 2024 • 211 • 4

Orion-zhen/Qwen2.5-14B-Instruct-Uncensored-Q5_K_M-GGUF

15B • Updated Oct 21, 2024 • 1.04k • 3

ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 2.05k • 11

roleplaiapp/Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q6_K-GGUF

Text Generation • 15B • Updated Jan 29, 2025 • 795 • 4

hellork/BlenderLLM-IQ3_XXS-GGUF

Text-to-3D • 8B • Updated Feb 2, 2025 • 222 • 7

ggml-org/Qwen2.5-Coder-3B-Instruct-Q8_0-GGUF

Text Generation • 3B • Updated Feb 27, 2025 • 929 • 2

smirki/UIGEN-T1.2-REACTv19-14B-Q4_K_M-GGUF

15B • Updated Mar 3, 2025 • 8 • 2

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 420 • 53

TawanaState/SmolVLM2-256M-Video-Instruct-Q4_K_M-GGUF

Image-Text-to-Text • 0.2B • Updated Jul 18, 2025 • 67 • 1

Trendyol/Qwen3-14B-BaronLLM-v2-Q8

15B • Updated Aug 20, 2025 • 196 • 10

ggml-org/Qwen3-Coder-30B-A3B-Instruct-Q8_0-GGUF

Text Generation • 31B • Updated Aug 20, 2025 • 1.44k • 13

bylang/meta-lama3.1-8b-Q4_K_M-GGUF

8B • Updated Sep 27, 2025 • 444 • 3

ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF

Text Ranking • 0.6B • Updated Oct 3, 2025 • 50k • 28

ggml-org/bge-m3-Q8_0-GGUF

Sentence Similarity • 0.6B • Updated Oct 12, 2025 • 8.8k • 16

Felladrin/gguf-MXFP4-gpt-oss-20b-Derestricted

Text Generation • 21B • Updated Dec 5, 2025 • 222 • 18