Quantization, Large Language Models, Llm, Deep Learning, ChatGPT.
estimator (STE): it is approximated that the partial derivative of round is always 1: Post Training Quantization(PTQ) While QAT has been proven to work properly, the addition of fake-quantization nodes greatly increases computational costs, especially when facing LLMs. Current research on LLM