albanD:

Note that in general, it is better to sum the losses and do a single backward (speed wise).


So, what’s the take-home message of this statement?returning a torch.sum is “better” than a torch.mean, or am I missing something else here?