Quantization, Large Language Models, Llm, Deep Learning, ChatGPT.
and then dequantize them). This introduces quantization error, take affine quantization as an example, Note that during backpropagation, the gradient of the rounding operator round is almost zero everywhere, making backpropagation impossible. This is generally solved by the straight-through