I am not sure enough. I cannot download the corresponding paper and have no idea about how ASGD updates the parameters. Generally, the state[‘ax’] should be used for modifying the p.grad (gradient) as Adagrad or Adam does.