Hi @dnaik
In the quoted message I didn’t find that you did quantized the model with convert() API. If it is, then quantize the model with convert() API.
Refer to this Doc to quantize model with prepare & convert() APIs : Static quantization 6
Quantize_dynamic() is not applicable to your model because as of now it only supports to quantize lSTM and Linear layers.