Hi,
I have a question regarding the AdamW optimizer default weight_decay value.
In the Docs 3 we can clearly see that the AdamW optimizer sets the default weight decay to 0.0.
Given that the whole purpose of AdamW is to decouple the weight decay regularization, is my understanding that the results anyone can get with AdamW and Adam if both are used with  weight_decay=0.0  (this is, without weight decay) should be exactly the same.
Therefore, shouldn’t make more sense to have the default weight decay for AdamW > 0?
Thank you so much!