Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

456

Base only

Active filters: 8bit

mlx-community/MiMo-V2.6-Distill-Qwen-9B-OptiQ-4bit

Text Generation • 9B • Updated 11 days ago • 6.51k • 17

mlx-community/Qwen3.5-9B-MLX-8bit

9B • Updated Mar 2 • 1.23k • 15

mlx-community/cohere-transcribe-03-2026-mlx-8bit

Automatic Speech Recognition • Updated Apr 11 • 8

majentik/Kokoro-82M-MLX-8bit

Text-to-Speech • 81.8M • Updated Apr 17 • 72 • 2

mlx-community/Devstral-Small-2-24B-Instruct-2512-OptiQ-4bit

Text Generation • 24B • Updated 14 days ago • 1.29k • 3

vanch007/mlx-indextts2-2.5-8bit

Text-to-Speech • Updated Aug 11 • 520 • 2

asjadilahi/danAI-55M-Reasoning

Text Generation • 54.5M • Updated Aug 26 • 335 • 12

RolanDorisTech/Qwen3.8-4B-Distill-MLX-8bit

4B • Updated about 20 hours ago • 138 • 1

zeechimp/chaos-chip-census

Updated 1 day ago • 1

zeechimp/chaos-chip-universal-k10-13

Updated 1 day ago • 1

zeechimp/chaos-chip-reverse-universal

Updated 1 day ago • 10 • 1

zeechimp/chaos-chip-k13-seed-corpus

Updated 1 day ago • 10 • 1

zeechimp/chaos-chip-compressed

Updated 1 day ago • 11 • 1

Jommarn/UNSEEN_Gemma_4_26B_NSFW-GGUF

Image-Text-to-Text • 25B • Updated Sep 1 • 32.4k • 95

0xSojalSec/UNSEEN_Gemma_4_26B_NSFW-GGUF

Image-Text-to-Text • 25B • Updated 14 days ago • 1.88k • 2

crumb/gpt-j-6b-finetune-super-glue

Text Generation • Updated Jul 17, 2022 • 31

ethzanalytics/gpt-j-6B-8bit-sharded

Text Generation • 6B • Updated Jan 10, 2025 • 34 • 7

ethzanalytics/gpt-j-8bit-daily_dialogues

Text Generation • 6B • Updated Dec 25, 2024 • 35 • 5

ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps

Text Generation • Updated Nov 27, 2022 • 31

ethzanalytics/dolly-v2-12b-sharded-8bit

Text Generation • Updated Apr 29, 2023 • 37 • 4

pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit

Summarization • 3B • Updated Dec 29, 2025 • 24

ethzanalytics/open_llama_13b-sharded-8bit

Text Generation • Updated Jul 2, 2023 • 21

richardr1126/spider-skeleton-wizard-coder-8bit

Text Generation • Updated Jul 26, 2023 • 26 • 1

Trelis/Llama-2-7b-chat-hf-hosted-inference-8bit

Text Generation • 7B • Updated Nov 9, 2023 • 35 • 7

Trelis/mpt-7b-instruct-hosted-inference-8bit

Text Generation • Updated Aug 14, 2023 • 22

ecastera/eva-mistral-catmacaroni-7b-spanish

Text Generation • 7B • Updated Jan 29, 2024 • 14 • 3

ecastera/eva-mistral-turdus-7b-spanish

Text Generation • 7B • Updated Jan 29, 2024 • 13

ecastera/eva-mistral-7b-spanish-GGUF

7B • Updated Jan 29, 2024 • 70 • 11

BioMistral/BioMistral-7B-BnB.8

Text Generation • 7B • Updated Feb 19, 2024 • 25

alokabhishek/Llama-2-7b-chat-hf-bnb-8bit

Text Generation • 7B • Updated Apr 2, 2024 • 17 • 2