Red Hat

RedHatAI's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Articles

mgoin 

in RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic 1 day ago

Why not FP8 with static and per-tensor quantization?

1

#2 opened 2 days ago by

wanzhenchn

nm-research 

published 5 models 1 day ago

RedHatAI/Mixtral-8x22B-v0.1-quantized.w4a16

Updated Jan 3 • 2

RedHatAI/phi-4-FP8-dynamic

Updated Mar 3 • 4

RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic

Updated Dec 11, 2024 • 9 • 4

RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16

Updated Jan 2 • 17

RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8

Updated Mar 4 • 2

robgreenberg3 

published 3 models 3 days ago

RedHatAI/Qwen2.5-7B-Instruct-FP8-dynamic

Updated Nov 27, 2024 • 2

RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8

Updated Oct 9, 2024 • 2

RedHatAI/Qwen2.5-7B-quantized.w4a16

Updated Oct 18, 2024 • 2

mgoin 

updated a model 3 days ago

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Updated 3 days ago • 365 • 5

ekurtic 

updated a model 3 days ago

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Updated 3 days ago • 365 • 5

ekurtic 

published a model 3 days ago

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Updated 3 days ago • 365 • 5

mgoin 

published 8 models 4 days ago

RedHatAI/Phi-3-mini-128k-instruct-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 2

RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 2

RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 2

RedHatAI/Phi-3-medium-128k-instruct-FP8

Text Generation • Updated Oct 9, 2024 • 5

RedHatAI/Phi-3-mini-128k-instruct-FP8

Text Generation • Updated Oct 9, 2024

RedHatAI/Phi-3-mini-128k-instruct-quantized.w8a8

Text Generation • Updated Oct 9, 2024

RedHatAI/Phi-3-mini-128k-instruct-quantized.w4a16

Text Generation • Updated Oct 9, 2024 • 1

RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w8a16

Text Generation • Updated Oct 9, 2024