Hello @mohit7,
Did you try to follow our quantization tutorial https://pytorch.org/tutorials/advanced/static_quantization_tutorial.html 135 ?
If yes, which of the steps does not work or need more details/comments?