Hi all,
I’m usually using AdamW optimizer implemented by egg-west 109, since it is obviously and definitely effective when I train models. So I wonder why PyTorch doesn’t include AdamW or SGDR in our official optimizer sets. Is there any specific reason that AdamW or SGDR has some unclear issues in theory or in their implementation?
Thanks,
Jinserk