How did you create the model_wts? Note that the state_dict will store references to the parameters, which would thus also get updated, if you didn’t use copy.deepcopy(model.state_dict()).
In that case, you would reload the current state_dict and would thus just continue with the model training.