Quantization, Large Language Models, Llm, Deep Learning, ChatGPT.
granularity refers to the size of the range when calculating the quantization coefficient s, in other words, it means what is the granularity of the calculation range [β, α] for weight pruning. The smaller this range, the fewer parameters to be quantized share the same coefficient s, and naturally,