Why do we need to set the gradients manually to zero in pytorch? e.g:
w1.grad.data.zero_()
why do we need that? What happens if we don’t use that?
It feels that needing to ask this question means there is something conceptual/fundamental about the design of pytorch that I dont understand.