I would use the 'mean' reduction as the default value and try out different learning rates.
Otherwise your training (and learning rate) will depend on the batch size.
However, if a summed loss gives better convergence than the mean, a possible explanation would be the increased scale of the gradients.