Hi, I was trying to implement this:

  
      research.fb.com
  
  
    
imagenet1kin1h5.pdf 5

545.05 KB

  
  
    
    
  
  


i.e., linearly increase learning rate every epoch until a certain target. Any advice on how to do this with the Adam Optimizer, and the LR Scheduler?
Thanks!