It seems a new key named lr0 is added the all param groups. If I’m not mistaken, this key is not used in PyTorch optimizers so I guess your script might be using it somewhere manually.


Yes, that should be the case.