Hi,
Some optimizers using current_step like Adam manage it as step in each param_group of self.param_groups
See https://github.com/pytorch/pytorch/blob/master/torch/optim/adam.py#L72-L106 259.
On the other hand, optimizers like naive SGD do not manage current_step.