Hi, everyone,
I am referring the ASGD optimizer source code,  link
https://pytorch.org/docs/stable/_modules/torch/optim/asgd.html#ASGD
and confused with the following segment
            if state['mu'] != 1:
                state['ax'].add_(p.sub(state['ax']).mul(state['mu']))
            else:
                state['ax'].copy_(p)

It seems that the state[“ax”] is not used in the whole code.  It just computes this variable and this variable is not used for update parameters.
Is it a bug?