Solved by richard in post #2 
              
              
                The loss is reduced by default. https://pytorch.org/docs/stable/nn.html?highlight=loss#torch.nn.MSELoss You can pass it "reduction=‘none’ and perform your desired reduction.