mlx-community/quantized-gemma-2b-it
Text Generation
•
Updated
•
1.02k
•
10
Quantized MLX LLMs
-
-
mlx-community/Meta-Llama-3.1-8B-Instruct-4bit
Text Generation • Updated • 13.9k • 16 -
mlx-community/Mistral-Large-Instruct-2407-4bit
Updated • 477 • 1 -
mlx-community/Phi-3-mini-4k-instruct-4bit-no-q-embed
Text Generation • Updated • 445 • 3 -
mlx-community/Dolphin-2.9.3-Mistral-Nemo-12b-4bit
Updated • 23 -
mlx-community/dolphin-2.9.4-gemma2-2b-4bit
Updated • 7 • 2 -
mlx-community/zephyr-7b-beta-4bit
Text Generation • Updated • 42 • 1