We can’t quantize batchnorm, you’ll need to fuse batchnorm layer first, please follow the tutorial(https://pytorch.org/tutorials/advanced/static_quantization_tutorial.html#model-architecture 18) to fuse the conv and batchnorm relu first. You can also take a look at our test to see how to use the fusion API: https://github.com/pytorch/pytorch/blob/master/test/test_quantization.py#L949 15