Yes, it might change some internal states, such as running estimates of the gradients if these are used, so that you should save the optimizer.stat_dict() additionally to the model.state_dict() to restore the training later.
In case the optimizer doesn’t use these estimates, saving the state_dict() wouldn’t change anything and I would recommend to use it anyway.