Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

19

Full-text search

Active filters: fbgemm_fp8

meta-llama/Llama-3.1-405B-Instruct-FP8

Text Generation • 406B • Updated Sep 25, 2024 • 8.97k • 189

nm-testing/llama-3-8b-instruct-fbgemm-test-model

Text Generation • 8B • Updated Jul 18, 2024 • 18

nm-testing/Meta-Llama-3-8B-Instruct-FBGEMM-nonuniform

Text Generation • 8B • Updated Jul 20, 2024 • 18

meta-llama/Llama-3.1-405B-FP8

Text Generation • 406B • Updated Dec 6, 2024 • 3.02k • • 117

nm-testing/Meta-Llama-3-70B-Instruct-FBGEMM-nonuniform

Text Generation • 71B • Updated Jul 20, 2024 • 76 • 1

PrimeIntellect/Meta-Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Aug 16, 2024 • 36

NousResearch/Meta-Llama-3.1-405B-FP8

Text Generation • 410B • Updated Jul 25, 2024 • 9 • 3

Bllossom/llama-3.1-Korean-Bllossom-405B

Text Generation • 410B • Updated Dec 13, 2024 • 34 • 55

PygmalionAI/Eleusis-12B-FBGEMM-FP8

Text Generation • 12B • Updated Jan 29 • 10

mikeriess/Llama-3.3-70B-Instruct-FP8

Text Generation • 71B • Updated Mar 11 • 33

mikeriess/Gemma-2-27B-IT-FP8

Text Generation • 27B • Updated Mar 11 • 16

mikeriess/Llama-3.1-Nemotron-70B-Reward-HF-FP8

Text Generation • 71B • Updated Mar 12 • 27

InfiniAILab/QwQ-32B-FP8

33B • Updated Mar 16 • 5

hugging-quants/Llama-4-Scout-17B-16E-Instruct-fbgemm-unfused

Image-Text-to-Text • 109B • Updated Apr 9 • 48 • 2

hugging-quants/Llama-4-Scout-17B-16E-Instruct-fbgemm

Image-Text-to-Text • 109B • Updated Apr 9 • 25 • 2

chutesai/Llama-3.1-405B-FP8

Text Generation • 406B • Updated Apr 20 • 1.83k

haoqiwang/MNLP_M2_quantized_model

Text Generation • 0.6B • Updated May 25 • 5

haoqiwang/mnlp_m2_mcqa_model_cot00_e3_smooth_fbgemm_down2_26_27

Text Generation • 0.6B • Updated Jun 7 • 13

haoqiwang/MNLP_M3_quantized_model

Text Generation • 0.6B • Updated about 1 month ago • 19