This is not related to PyTorch Quantization.
To get help faster, I think it is better to add a different tag. Maybe “CUDA”?
Meanwhile, @Sai_Kiran can you explain what is the 20x slow down compared to (as Daya asked: what’s the baseline)?
Also, CUDA doesn’t really benefit from quantization unless you are using TensorRT (see this for throughputs in CUDA)