github.com/pytorch/pytorch
  
  
      
    
  


  Fixing Weight Decay Regularization in Adam  35



  by jingweiz
  on 07:02PM - 16 Nov 17 UTC



  16 commits
  changed 8 files
  with 398 additions
  and 0 deletions.


  
  
    
    
  
  


I found a PR for AdamW.
(Edit)

  
      github.com/pytorch/pytorch
  
  
      
    
  


  Decoupled Weight Decay Regularization in optimizers (added adamw and sgdw among others) 36



  by kashif
  on 05:54PM - 01 Jan 18 UTC



  43 commits
  changed 9 files
  with 208 additions
  and 36 deletions.


  
  
    
    
  
  


I think this PR is better than the above one.