Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Models

18

Full-text search

Active filters: w4a16

RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16

Image-Text-to-Text • Updated 29 days ago • 381 • 3

RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w4a16

Image-Text-to-Text • Updated 29 days ago • 145 • 2

nm-testing/whisper-large-v3.w4a16

Automatic Speech Recognition • Updated Feb 14 • 13 • 1

RedHatAI/Qwen2-VL-72B-Instruct-FP8-dynamic

Image-Text-to-Text • Updated Mar 31 • 20

RedHatAI/Mixtral-8x22B-v0.1-quantized.w4a16

Updated Jan 3 • 8

RedHatAI/Mixtral-8x7B-v0.1-quantized.w4a16

Updated Mar 1 • 60

RedHatAI/granite-3.1-8b-instruct-quantized.w4a16

Text Generation • Updated Feb 28 • 390 • 1

RedHatAI/granite-3.1-2b-instruct-quantized.w4a16

Text Generation • Updated Feb 28 • 139

RedHatAI/granite-3.1-2b-base-quantized.w4a16

Text Generation • Updated Feb 28 • 14

RedHatAI/granite-3.1-8b-base-quantized.w4a16

Text Generation • Updated 24 days ago • 67

RedHatAI/Qwen2-VL-72B-Instruct-quantized.w4a16

Image-Text-to-Text • Updated Mar 31 • 38

RedHatAI/Phi-3-vision-128k-instruct-W4A16-G128

Text Generation • Updated Feb 10 • 2 • 1

RedHatAI/whisper-large-v2-W4A16-G128

Automatic Speech Recognition • Updated Jan 31 • 35 • 1

RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w4a16

Image-Text-to-Text • Updated Mar 31 • 126

RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w4a16

Image-Text-to-Text • Updated 29 days ago • 386 • 3

RedHatAI/pixtral-12b-quantized.w4a16

Image-Text-to-Text • Updated Feb 26 • 143 • 1

RedHatAI/Llama-3.2-11B-Vision-Instruct-quantized.w4a16

Image-Text-to-Text • Updated Feb 13 • 225

neuralmagic-ent/whisper-large-v2-quantized.w4a16

Automatic Speech Recognition • Updated 10 days ago • 6