Models

Qwen/Qwen3-235B-A22B-MLX-4bit

Text Generation • 33B • Updated Jul 7 • 1.15k • 14

unsloth/Mistral-Small-3.2-24B-Instruct-2506-unsloth-bnb-4bit

Image-Text-to-Text • 13B • Updated Jun 23 • 10.6k • 7

QuantTrio/Qwen3-Coder-480B-A35B-Instruct-AWQ

Text Generation • 66B • Updated 1 day ago • 1.75k • 2

inferencerlabs/Kimi-K2-Instruct-MLX-3.985bit

Text Generation • 1T • Updated 15 days ago • 1.39k • 2

QuantTrio/GLM-4.5-GPTQ-Int4-Int8Mix

Text Generation • Updated 13 days ago • 793 • 4

tencent/Hunyuan-7B-Instruct-GPTQ-Int4

Text Generation • 1B • Updated 6 days ago • 190 • 4

Intel/Mistral-Small-3.2-24B-Instruct-2506-int4-AutoRound

2B • Updated 7 days ago • 45 • 2

NexVeridian/gpt-oss-20b-4bit

Text Generation • 21B • Updated about 5 hours ago • 1.74k • 2

nightmedia/gpt-oss-20b-q4-hi-mlx

Text Generation • 21B • Updated 6 days ago • 1.54k • 2

AlekseyCalvin/QWEN_IMAGE_fp4_w_AbliteratedTE_Diffusers

Text-to-Image • Updated 6 days ago • 200 • 2

lmstudio-community/Qwen3-4B-Thinking-2507-MLX-4bit

Text Generation • 0.6B • Updated 6 days ago • 850 • 2

mlx-community/Qwen3-4B-Instruct-2507-DDWQ

0.7B • Updated 4 days ago • 19 • 2

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • 2B • Updated Sep 27, 2023 • 5.75k • 212

Qwen/Qwen-7B-Chat-Int4

Text Generation • 2B • Updated Jan 4, 2024 • 1.82k • 75

TheBloke/Llama-2-7B-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 961 • 17

AISimplyExplained/Vakil-7B

Text Generation • 4B • Updated Jan 23, 2024 • 872 • 4

TheBloke/EstopianMaid-13B-GPTQ

Text Generation • 2B • Updated Jan 26, 2024 • 36 • 18

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • 4B • Updated Feb 17, 2024 • 238 • 38

MaziyarPanahi/gemma-7b-GGUF

Text Generation • 9B • Updated Feb 29, 2024 • 790 • 11

solidrust/Genstruct-7B-AWQ

Text Generation • 1B • Updated Sep 3, 2024 • 6 • 1

unsloth/mistral-7b-v0.2-bnb-4bit

Text Generation • 4B • Updated Sep 11, 2024 • 200 • 15

CohereLabs/c4ai-command-r-plus-4bit

Text Generation • 55B • Updated Apr 16 • 130 • 255

unsloth/llama-3-8b-bnb-4bit

Text Generation • 5B • Updated Jan 7 • 31.5k • 199

leliuga/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • 2B • Updated Jun 8, 2024 • 344 • 5

amazon/MistralLite-AWQ

Text Generation • 1B • Updated May 20, 2024 • 7 • 5

solidrust/Mistral-7B-Instruct-v0.3-AWQ

Text Generation • 1B • Updated Sep 3, 2024 • 1.96k • 5

unsloth/gemma-2-9b-bnb-4bit

Text Generation • 5B • Updated 21 days ago • 8.28k • 30

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • 2B • Updated Aug 7, 2024 • 245k • 73

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 5B • Updated Feb 15 • 363k • 80

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 158k • 24