Hi Simon
Thank you for the reply.
For the first approach, I print out the gradient after the backward() and it do change to zero, but the weight itself still update. So I guess the step function still use the old gradient.
For the second approach, I change the _grad to grad as you said and it does not work either.
Thank you.