Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

27,998

Full-text search

Active filters: 4-bit

mlx-community/DeepSeek-V3-0324-4bit

Text Generation • Updated 4 days ago • 475 • 27

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • Updated about 20 hours ago • 1.64k • 16

cognitivecomputations/DeepSeek-V3-0324-AWQ

Text Generation • Updated 2 days ago • 748 • 8

FunAGI/Qwen2.5-Omni-7B-GPTQ-4bit

Any-to-Any • Updated about 6 hours ago • 16 • 7

unsloth/QwQ-32B-unsloth-bnb-4bit

Text Generation • Updated 21 days ago • 24.6k • 36

gaunernst/gemma-3-27b-it-int4-awq

Image-Text-to-Text • Updated 6 days ago • 1.74k • 5

AIDC-AI/Ovis2-34B-GPTQ-Int4

Image-Text-to-Text • Updated about 8 hours ago • 153 • 4

unsloth/Qwen2.5-VL-32B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 1 day ago • 1.74k • 4

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 2.15M • 88

mlx-community/DeepSeek-R1-Distill-Qwen-7B-4bit

Updated 30 days ago • 6.59k • 17

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated 2 days ago • 55.2k • 74

unsloth/Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated Jan 31 • 2.71k • 7

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated 21 days ago • 195k • 44

Qwen/QwQ-32B-AWQ

Text Generation • Updated 17 days ago • 202k • 102

mlx-community/QwQ-32B-4bit

Text Generation • Updated 23 days ago • 5.75k • 35

LGAI-EXAONE/EXAONE-Deep-32B-AWQ

Text Generation • Updated 9 days ago • 1.44k • 14

infinitestack/tinyllama-sugarcane

Updated 4 days ago • 6 • 3

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 78.7k • 24

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 1.96M • 18

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 88.2k • 99

casperhansen/deepseek-r1-distill-qwen-7b-awq

Updated Feb 8 • 9.31k • 7

mlx-community/DeepSeek-R1-Distill-Qwen-32B-4bit

Text Generation • Updated 30 days ago • 108k • 40

vital-ai/watt-tool-70B-awq

Updated Jan 24 • 117 • 2

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated Jan 30 • 994k • 2

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Text Generation • Updated 9 days ago • 44.4k • 17

unsloth/Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit

Text Generation • Updated Feb 2 • 32.8k • 14

unsloth/Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 19 days ago • 31.8k • 25

Vikhrmodels/QVikhr-2.5-1.5B-Instruct-SMPO_MLX-4bit

Text Generation • Updated Feb 3 • 326 • 2

mlx-community/watt-tool-8B

Updated Feb 13 • 66 • 4

onekq-ai/QwQ-32B-bnb-4bit

Text Generation • Updated 23 days ago • 379 • 2