rmehta1987:

@ ptrblck


It seems there is a way to dynamically change the learning rate as in:
https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate 38
Can I follow a similar step to change the parameters without losing the running averages?  I know param_groups keeps the learning rate, is there a similar access to all the weights?