Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

561

Full-text search

Active filters: vllm

mistralai/Mistral-Small-3.1-24B-Instruct-2503

Image-Text-to-Text • Updated 6 days ago • 102k • 1.01k

mistralai/Mistral-Small-3.1-24B-Base-2503

Updated 9 days ago • 17.1k • 180

unsloth/Mistral-Small-3.1-24B-Instruct-2503-GGUF

Updated 10 days ago • 19.4k • 16

mistralai/Ministral-8B-Instruct-2410

Updated Dec 6, 2024 • 115k • 459

mistralai/Mistral-Small-24B-Base-2501

Text Generation • Updated Jan 30 • 23.7k • 237

NousResearch/DeepHermes-3-Mistral-24B-Preview

Text Generation • Updated 15 days ago • 8.85k • 86

NousResearch/DeepHermes-3-Llama-3-8B-Preview

Text Generation • Updated 15 days ago • 50.5k • 302

NousResearch/DeepHermes-3-Mistral-24B-Preview-GGUF

Updated 15 days ago • 3.13k • 23

ISTA-DASLab/Mistral-Small-3.1-24B-Instruct-2503-GPTQ-4b-128g

Image-Text-to-Text • Updated 8 days ago • 1.05k • 7

mistralai/Mistral-Small-Instruct-2409

Updated Oct 16, 2024 • 5.57k • 385

mistralai/Mistral-Small-24B-Instruct-2501

Text Generation • Updated Feb 2 • 315k • • 886

ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g

Image-Text-to-Text • Updated 8 days ago • 26k • 11

mistralai/Pixtral-Large-Instruct-2411

Image-Text-to-Text • Updated 12 days ago • 31 • 404

MERaLiON/MERaLiON-AudioLLM-Whisper-SEA-LION

Automatic Speech Recognition • Updated 2 days ago • 3.68k • 12

Karsh-CAI/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

Updated Jan 30 • 35 • 2

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Text Generation • Updated 9 days ago • 44.4k • 17

Almawave/Velvet-14B

Text Generation • Updated Feb 20 • 4.78k • 132

NousResearch/DeepHermes-3-Llama-3-3B-Preview

Text Generation • Updated 15 days ago • 4.8k • • 28

unsloth/Mistral-Small-3.1-24B-Instruct-2503

Updated 10 days ago • 662 • 8

unsloth/Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit

Updated 10 days ago • 7.54k • 4

neuralmagic/Meta-Llama-3-8B-Instruct-FP8

Text Generation • Updated Jul 18, 2024 • 11.5k • 23

neuralmagic/Meta-Llama-3-8B-Instruct-FP8-KV

Text Generation • Updated Jun 19, 2024 • 12.6k • 7

neuralmagic/Qwen2-72B-Instruct-FP8

Text Generation • Updated Jul 18, 2024 • 517 • 14

neuralmagic/Qwen2-0.5B-Instruct-FP8

Text Generation • Updated Jul 18, 2024 • 7.1k • 3

neuralmagic/gemma-2-9b-it-FP8

Text Generation • Updated Jul 18, 2024 • 827 • 6

neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • Updated Oct 9, 2024 • 49.7k • 40

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8-dynamic

Text Generation • Updated Oct 19, 2024 • 4.69k • 6

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 33.9k • 14

mistralai/Mistral-Large-Instruct-2407

Updated Oct 16, 2024 • 7.09k • 825

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated Dec 17, 2024 • 126k • 24