Does your model only contain conv and linear layers? I.e. no batchnorm layers or others?
If you are using batchnorm layers, their running estimates as well as affine parameters won’t be reset.
Also, use copy.deepcopy(base_net.state_dict()), as init_dict will hold a reference to the state_dict.