Llm, AI, Deep Learning, Optimization.
ensure precision is maintained. One big challenge for representing weights using lower precision is the smaller numerical range an INT8 can represent, as shown below: Source Types of Quantization Strategies 1.Post-Training Quantization 2.Quantization-Aware Training QAT — PTQ — arxiv:2103.13630 1.