Thanks for your suggestion. I have tried to print out required_grad in each parameters in the model. It showed that CNN layers are false and fully connected layers are true… So, that is not the problem of this issue…