At the beginning of a training session, the Adam Optimizer takes quiet some time, to find a good learning rate. I would like to accelerate my training by starting a training with the learning rate, Adam adapted to, within the last training session.
Therefore, I would like to print out the current learning rate, Pytorchs Adam Optimizer adapts to, during a training session.
thanks for your help