Large Language Models, Quantization, Machine Learning, Data Science, Hands On Tutorials.
slightly better than absmax, but is also more costly to compute. In this example, we applied quantization techniques to entire layers (per-tensor basis). However, we could apply it at different granularity levels: from the entire model to individual values. Quantizing the entire model in one pass