Models

mistralai/Mistral-Small-24B-Base-2501

Text Generation • Updated Jan 30 • 11.9k • • 251

RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8

Text Generation • Updated Feb 27 • 3.57k • 11

RedHatAI/Qwen2.5-VL-7B-Instruct-FP8-Dynamic

Image-Text-to-Text • Updated Apr 3 • 41.7k • 3

NousResearch/DeepHermes-3-Llama-3-8B-Preview

Text Generation • Updated Apr 10 • 14.4k • • 339

NousResearch/DeepHermes-3-Mistral-24B-Preview

Text Generation • Updated Mar 13 • 2.79k • 108

ISTA-DASLab/Mistral-Small-3.1-24B-Instruct-2503-GPTQ-4b-128g

Image-Text-to-Text • Updated Apr 6 • 3.45k • 14

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Image-Text-to-Text • Updated 28 days ago • 8.4k • 25

ISTA-DASLab/gemma-3-12b-it-GPTQ-4b-128g

Image-Text-to-Text • Updated Apr 13 • 28.1k • 5

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

Image-Text-to-Text • Updated 28 days ago • 3.45k • 5

RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16

Image-Text-to-Text • Updated 28 days ago • 8.92k • 8

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503

Image-Text-to-Text • Updated 28 days ago • 83 • 1

bullerwins/Devstral-Small-2505-fp8

Text2Text Generation • Updated May 21 • 861 • 4

lucyknada/unsloth_Devstral-Small-2505-exl3

Text2Text Generation • Updated May 21 • 4 • 1

huihui-ai/Devstral-Small-2505-abliterated

Text2Text Generation • Updated 18 days ago • 65 • 7

Mungert/Devstral-Small-2505-GGUF

Text2Text Generation • Updated 12 days ago • 3.57k • 4

RedHatAI/gemma-3-12b-it-quantized.w8a8

Image-Text-to-Text • Updated 18 days ago • 237 • 1

RedHatAI/gemma-3-27b-it-quantized.w8a8

Image-Text-to-Text • Updated 18 days ago • 496 • 5

RedHatAI/gemma-3-27b-it-quantized.w4a16

Image-Text-to-Text • Updated 18 days ago • 302 • 1

RedHatAI/Magistral-Small-2506-FP8

Updated 17 days ago • 6.79k • 6

huihui-ai/Magistral-Small-2506-abliterated

Text2Text Generation • Updated 9 days ago • 162 • 9

unsloth/Mistral-Small-3.2-24B-Instruct-2506-FP8

Image-Text-to-Text • Updated 6 days ago • 4 • 1

matatonic/Mistral-Small-3.2-24B-Instruct-2506-5.0bpw-exl2

Image-Text-to-Text • Updated 6 days ago • 11 • 1

Inferless/deciLM-7B-GPTQ

Text Generation • Updated Jan 4, 2024 • 27 • 1

Inferless/SOLAR-10.7B-Instruct-v1.0-GPTQ

Text Generation • Updated Jan 4, 2024 • 32 • 2

Inferless/Mixtral-8x7B-v0.1-int8-GPTQ

Text Generation • Updated Jan 25, 2024 • 337 • 2

RedHatAI/Meta-Llama-3-8B-Instruct-FP8

Text Generation • Updated Jul 18, 2024 • 3.53k • 23

RedHatAI/Mixtral-8x7B-Instruct-v0.1-AutoFP8

Text Generation • Updated Jul 18, 2024 • 167 • 3

RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV

Text Generation • Updated Jun 19, 2024 • 5.32k • 8

RedHatAI/Meta-Llama-3-70B-Instruct-FP8

Text Generation • Updated Jul 18, 2024 • 55.7k • 13

RedHatAI/Qwen2-72B-Instruct-FP8

Text Generation • Updated Jul 18, 2024 • 2.41k • 15