Llm, Model Quantization, Deep Learning, Machine Learning, Large Language Models.
The main task of model quantization in deep learning is to convert high-precision floating-point numbers in neural networks into low-precision numbers. The essence of model quantization is function mapping. By representing floating-point data with fewer bits, model quantization can reduce the size