Quantization, Large Language Models, Llm, Deep Learning, ChatGPT.
This is the third article in the model quantization series. The previous two articles introduced the basics of model quantization and the two main methods of model quantization, respectively. This article focuses on the timing and granularity of model quantization. Timing of Model Quantization The