Solved by Vasiliy_Kuznetsov in post #4 
              
              
                You can use pytorch/observer.py at master · pytorch/pytorch · GitHub, this is also what the official quantization flows use.  For example, 
obs = torch.quantization.MinMaxObserver(...)
# run data through the observer
obs(your_tensor)
# get scale and zp from the data observer has seen
scale, zp = obs…