Solved by deepak_mangla in post #2 
              
              
                I  compared output of all layers of original model and loaded  model. I found output of BatchNorm2d was different. 
The problems is Pytorch wasn’t saving ‘scale’ and ‘zero_point’ of unfused QuantizedBatchNorm in checkpoints. Two solutions - 

Save these values as pickle when saving model. While load…