Machine Learning, Mxnet, Quantization, Inference, Deterministic.
Quantization: also known as fake quantization [1], quantizing floating-point numbers into 8-bit integers and transferring data to the accelerator, which takes linear time. The most costly part of the calculation, e.g., conv, only happens in the accelerator which is dedicated in the 8-bit