saul_santos:

But to be an error getting the gradients wouldn’t all gradients for all layers be None and not only the grad for the last layer biases tensor?


I’m not sure to understand your question here.