Hi @yyl-github-1896
quantized models currently run only during inference so you can only call forward on them. If you are trying out quantization aware training Quantization Recipe — PyTorch Tutorials 1.9.1+cu102 documentation 4, we do support back-propagation in that case during training.