Llm, Model Quantization, Deep Learning, Machine Learning, Large Language Models.
during the backward pass. Conclusion This article mainly explains the concept of model quantization, fixed-point numbers and floating-point numbers, as well as the objects of model quantization. The subsequent articles in this series mainly cover common quantization methods, stages of model