As per the documentation, LBFGS is taking a only one step as per the step definition in the below link. http://pytorch.org/docs/master/optim.html 78
But inside the lbfgs.py file, it is taking more steps and not the same as reported in the documentation.