dassima:

they accumulate the result to 32int for each layer and requantize to 8 int using another scale


So, does this requantization step in each layer (to convert its output to INT8 with another scale) requires the hardware to support FP32 arithmetic?
Also, how expensive would this conversion be compared to doing everything in FP32?