@jerryzh168 I printed the model and everything is properly quantized.
In squeezenet I have to replace torch.cat to nn.FloatFunctional.cat so I think that function is giving issues which is also mentioned in other threads also