Hi,
If you go to the implementation 3 you’ll se that in each call (lr_scheduler.step()), the current learning rates are decayed by gamma, so LRi = LR_i-1 x gamma, and in terms of the base learning rate: LRi = LR0 x gamma^i.