Thanks for your fast reply,
I know the loss is ‘continue’ because the value is smaller than training without loading model param, which will be something like this, the G_loss and adv loss bigger
[Epoch 0/200] [Batch 156/6000] [D loss: 0.766469] [G loss: 15.088398, pixel: 0.005941, adv: 5.494318] ETA: 17:56:19.482757

So, May I conclude it will be better to load optimizer.state_dict, but there will be significant difference ? Maybe it makes a difference for longer training, but not huge difference?