Please use the code formatting tool in future.


Each p is one of the parameter Variables of the model. p.grad is the Variable containing the gradients for that parameter.


There will be several param_groups if you specify different learning rates for different parameters when you initialize the optimizer (as explained above).