Mark Kurtz

markurtz's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic 5 months ago

What is the difference between this and "neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8"

1

#1 opened 5 months ago by

RonanMcGovern

commented a paper 7 months ago

"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization

Paper • 2411.02355 • Published Nov 4, 2024 • 51 •

3

New activity in RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic 7 months ago

Can you please add Nemotron 70B static?

3

#1 opened 7 months ago by

nickandbro

New activity in RedHatAI/Phi-3-mini-128k-instruct-FP8 10 months ago

Prompt format in `tokenizer_config.json`

3

#1 opened 10 months ago by

justinthelaw

New activity in RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 10 months ago

Language support

1

#1 opened 10 months ago by

ashbo