Yes, this one

  
      pytorch.org
  
  
    

torch.optim.adam — PyTorch 1.6.0 documentation 1



  
  
    
    
  
  


2 values depend on state[‘step’] var.
bias_correction1 change lr at the start of training. Then it always will be 1.
Im not sure about bias_correction2.