Aha, I had rather unclear hint that this may be the case. Great.
But then if I
torch.save(optimizer.state_dict(),...)

that would not save the parameters. So sad. I had the clue before state dict should bear  all about the optimizer. Any comment.