Follow up question: Should reduction = ‘mean’ not only average over all the samples? It instead averages over every input, resulting in an 1x1 output. In my opinion, the MSE should only average over all the samples and result in separate errors for every feature, e.g. in a multivariate regression problem. This feature does not seem to be implemented.