Hi @guyrose3, How are you reducing the learning rate while using Adam? I’m trying to do a similar process, but it seems that PyTorch’s implementation of Adam does not account for an external learningrate scheduler.
I’ve started a thread on Stack Exchange. See this for more info:

  
      ai.stackexchange.com
  
  
      
    
  

  Loss jumps abruptly when I decay the learning rate 336



  machine-learning, deep-learning, autoencoders, loss-functions



  asked by
  
  
    vinaykumar2491
  
  on 01:14PM - 20 Sep 18