loss_norm = loss/loss.item() will have gradient in the same direction as loss, but scaled by `1/loss.item() because the gradient flows through loss but not loss.item() (which is a constant number to autograd).