Quantization, Large Language Models, Llm, Deep Learning, ChatGPT.
between dynamic quantization and static quantization. Figure 2 is an example of some algorithms: Figure 2 Conclusion This article introduces the timing and granularity of model quantization. It should be noted that appropriate quantization strategies should be chosen in different application