Solved by raghuramank100 in post #2 
              
              
                Hi, 
Dynamic quantization only helps in reducing the model size for models that use Linear and LSTM  modules. For the case of resnet18, the model consists of conv layers which do not have dynamic quantization support yet. For your model, can you check if it has linear layers?