Solved by Zafar in post #3 
              
              
                In PyTorch1.3, float-tensor has scale and zero_point. Could I set value to scale and zero_point to a float32 tensor without coverting fp32 tensor to quant? 

q_scale and q_zero_point exist in FP tensor, but they do not make sense outside of the quantization context. That’s why, if you try accessing…