In my work, I need to load external state_dict to the network during training, e.g.,
network.load_state_dict(new_param)

But after doing this, what do I need to do with the optimizer to ensure it optimizes the new_param?
Since the optimizer is initialized like,
optim.SGD(params=network.parameters(), lr=0.1)

After loading new state_dict, I guess the parameters in network and optimizer are no longer the same?
Thank you for any advices.