Currently quantized tensors are only supported during inference, there is no support for autograd.  If you are interested in simulating quantization numerics during training, you could fake quantize your tensors using the torch.quantization.FakeQuantize module or the torch.quantize_per_tensor function.  Would that help?