yayapa:

So the question is: Was the quantitation done correctly or I still use the full-precision weights? Why does it look like? Is it an intern representations of weights?


If you print a quantized tensor, it’s expected to see the floating point values, a scale and a zero point.  The internal representation is stored in integers, and you can see that with int_repr().  You can use the equation fp = clamp(std::nearbyint(q - zp) * scale, qmin, qmax) to convert from int + scale + zp to float.