peepeepoopoo:

I check the gradient of my weight matrix that I initialized in init and was able to get a value after backward(), that means that the backprop isn’t broken up until that point, would that be correct?


Yes, that’s correct.



 peepeepoopoo:

and trying to print loss.backward() would gave me none either way?


Yes, tensor.backward() doesn’t return anything.