Solved by Vasiliy_Kuznetsov in post #10 
              
              
                Hi Raghav, 
For post training quantization, we want the model to be in eval mode (see https://github.com/pytorch/pytorch/blob/530d48e93a3f04a5ec63a1b789c19a5f775bf497/torch/quantization/fuse_modules.py#L63).  So, you can add a model.eval() call before you fuse modules: 
model.eval()
torch.quantizati…