Quantization, Large Language Models, Llm, Deep Learning, ChatGPT.
the smaller the quantization error. To give an extreme example, if each parameter to be quantized corresponds to a separate coefficient s, then the quantization is lossless. But this loses the meaning of quantization: the required storage space does not decrease but increases. As an example, let’s