Models

microsoft/bitnet-b1.58-2B-4T

Text Generation • Updated May 1 • 10.2k • 1.1k

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 223k • 102

HF1BitLLM/Llama3-8B-1.58-100B-tokens

Text Generation • Updated Sep 19, 2024 • 2.75k • 188

JohnConnor123/Kimi-VL-A3B-Thinking-BNB-8bit

Updated Apr 30 • 28 • 2

mlx-community/Jan-nano-8bit

Text Generation • Updated 11 days ago • 336 • 2

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 367 • 9

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 1.38k • 129

John6666/gokaygokay-Florence-2-SD3-Captioner-8bit

Image-Text-to-Text • Updated Jun 27, 2024 • 48 • 2

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22, 2024 • 203k • 46

altomek/Nemomix-v3.0-12B-8bpw-EXL2

Text Generation • Updated Aug 30, 2024 • 36 • 2

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 199k • 13

MaziyarPanahi/mistral-sk-7b-GGUF

Text Generation • Updated Nov 1, 2024 • 44 • 1

PrunaAI/selimc-OrpoGemma-2-9B-TR-bnb-8bit-smashed

Updated Dec 22, 2024 • 20 • 1

MaziyarPanahi/Ninja-V3-nsfw-enhance-GGUF

Text Generation • Updated Dec 6, 2024 • 448 • 1

PrunaAI/vinhainsec-finall_sup_vcs-bnb-8bit-smashed

Updated Dec 28, 2024 • 79 • 1

mlx-community/DeepSeek-R1-Distill-Qwen-14B-8bit

Updated Feb 26 • 1.99k • 5

RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8

Text Generation • Updated 28 days ago • 9.88k • 8

Alissonerdx/YuE-s2-1B-general-int8

Updated Feb 3 • 62 • 2

RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8

Text Generation • Updated Feb 27 • 3.54k • 11

mlx-community/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview-Q8

Updated Feb 21 • 182 • 9

Emilio407/nllb-200-3.3B-8bit

Translation • Updated Feb 22 • 65 • 1

MaziyarPanahi/Llama-3.1-8B-RainbowLight-EtherealMix-GGUF

Text Generation • Updated Mar 11 • 120 • 1

MaziyarPanahi/gemma-3-1b-it-GGUF

Text Generation • Updated Mar 12 • 237k • 5

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • Updated Mar 12 • 208k • 8

LogicBombaklot/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct-mlx-8Bit

Text Generation • Updated Apr 17 • 104 • 1

mlx-community/Qwen3-0.6B-8bit

Text Generation • Updated May 4 • 2.76k • 3

mlx-community/Nemotron-Research-Reasoning-Qwen-1.5B-8bit

Updated 25 days ago • 224 • 2

RedHatAI/gemma-3-12b-it-quantized.w8a8

Image-Text-to-Text • Updated 18 days ago • 366 • 1

RedHatAI/gemma-3-27b-it-quantized.w8a8

Image-Text-to-Text • Updated 18 days ago • 632 • 5

humbleakh/qwen2.5-vl-3b-8bit-chain-of-zoom

Image-to-Text • Updated 19 days ago • 72 • 1