And do you manually provide grad_output to .backward() or autograd.grad() ?

Well i don’t think i am even aware of this  ; It’s a very simple training loop, nothing complicated at all except the loss_fn which i modified;