Edit Models filters

Apps

Apps with no match

Inference Providers

HF Inference API

Inference Providers with no match

Misc

Inference Endpoints

text-generation-inference

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

784

Full-text search

Active filters: vllm

mgoin/Minitron-8B-Base-FP8

Text Generation • Updated Jul 26, 2024 • 43 • 3

mgoin/nemotron-3-8b-chat-4k-sft-hf

Text Generation • Updated Nov 13, 2024 • 49

RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • Updated Oct 9, 2024 • 133k • 43

RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic

Text Generation • Updated 28 days ago • 42.8k • 4

RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8-dynamic

Text Generation • Updated Oct 19, 2024 • 2.04k • 6

RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • Updated Mar 25 • 260k • 48

RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Oct 9, 2024 • 3.44k • 31

RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8-dynamic

Text Generation • Updated Oct 19, 2024 • 171 • 15

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16

Text Generation • Updated Oct 23, 2024 • 3.39k • 10

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated 28 days ago • 15.8k • 17

mistralai/Mistral-Large-Instruct-2407

Updated Oct 16, 2024 • 11.9k • 832

mgoin/Nemotron-4-340B-Base-hf

Text Generation • Updated Aug 8, 2024 • 20 • 1

mgoin/Nemotron-4-340B-Base-hf-FP8

Text Generation • Updated Aug 8, 2024 • 51 • 2

RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 1.77k • 5

mgoin/Nemotron-4-340B-Instruct-hf

Text Generation • Updated Aug 8, 2024 • 90 • 4

mgoin/Nemotron-4-340B-Instruct-hf-FP8

Text Generation • Updated Aug 8, 2024 • 223 • 3

FlorianJc/ghost-8b-beta-vllm-fp8

Text Generation • Updated Jul 25, 2024 • 18

FlorianJc/Meta-Llama-3.1-8B-Instruct-vllm-fp8

Text Generation • Updated Jul 25, 2024 • 23

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated 28 days ago • 28.2k • 29

RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated Feb 11 • 9.51k • 20

RedHatAI/Meta-Llama-3.1-8B-FP8

Text Generation • Updated Mar 25 • 5.62k • 7

RedHatAI/Meta-Llama-3.1-70B-FP8

Text Generation • Updated Oct 9, 2024 • 1.88k • 2

RedHatAI/Meta-Llama-3.1-8B-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 52 • 1

RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 2.35k • 4

RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated Feb 12 • 7.87k • 32

RedHatAI/starcoder2-15b-FP8

Text Generation • Updated Oct 9, 2024 • 19

RedHatAI/starcoder2-7b-FP8

Text Generation • Updated Oct 9, 2024 • 59

RedHatAI/starcoder2-3b-FP8

Text Generation • Updated Oct 9, 2024 • 78

RedHatAI/Meta-Llama-3.1-405B-FP8

Text Generation • Updated Oct 9, 2024 • 22

bprice9/Palmyra-Medical-70B-FP8

Text Generation • Updated Aug 21, 2024 • 22 • 1