Solved by snehaoladri in post #2 
              
              
                I am finally able to achieve it by setting different config for the layers i want to quantize, rather than using model.qconfig (which does for all the layers in the model). 
For example: 
I quantized the first layer by accessing the first layer and assigning it the qconfig. 
per_channel_quantized_mo…