I see, so I have to register a hook on the tensor first? That will print the gradient with respect to the tensor right, not the parameters?
Also, I wonder if I could be facing zero gradients because of initializations in my weight matrix?