"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization Paper • 2411.02355 • Published Nov 4, 2024 • 49
Llama-3.1 Quantization Collection Neural Magic quantized Llama-3.1 models • 22 items • Updated Nov 22, 2024 • 43
nm-testing/Meta-Llama-3-70B-Instruct-FBGEMM-nonuniform Text Generation • Updated Jul 20, 2024 • 101 • 1