I was looking at the new paper by Geoffrey Hinton 67 and was wondering if it’s been implemented. Look at the article:

  
      
      Medium – 20 Aug 19
  
  
    

New Deep Learning Optimizer, Ranger: Synergistic combination of RAdam +... 136

A new paper in part by the famed deep learning researcher Geoffrey Hinton introduces the LookAhead optimizer(“LookAhead optimizer: k steps…

  Reading time: 9 min read
    

  
  
    
    
  
  



Cross posted:

https://www.quora.com/unanswered/Is-there-a-Pytorch-implementation-of-RAdam-LookAhead 120