Deep Learning, Artificial Intelligence, NLP, Self Supervised Learning, Quantization.
Quantization: To perform general quantization from one data type into another we require 3 steps: Compute a normalization constant N that transforms the input tensor T into the range of the domain D of the target quantization data type Qmap; For each element of T/N, find the closest corresponding