"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization
Paper
•
2411.02355
•
Published
•
51
Jenny Y
jennyyyi
AI & ML interests
None yet
Recent Activity
new activity
6 days ago
RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic:Update README.md
new activity
6 days ago
RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic:Update README.md
new activity
8 days ago
RedHatAI/granite-3.1-8b-instruct-quantized.w8a8:Update README.md
Organizations
