I’m trying to inspect the gradients of parameters in my model.  For one of them it is showing it does not have a gradient, but it changes with optimizer.step().  Taken from pdb:
-> atoptimizer.step()
(Pdb) variableName
tensor(0., device='cuda:0', grad_fn=<SelectBackward>)
(Pdb) variableName.grad
(Pdb) next
> file.py(476)train()
-> nextLine
(Pdb) variableName
tensor(3.7592e-08, device='cuda:0', grad_fn=<SelectBackward>)


How is the optimizer changing the value when it is showing nothing for the .grad field?