Thanks for pointing out this difference ! Yes, both metrics should be definitely made coherent between each other and the result of nn.MSELoss … and we also need to update the docs.
If you would like to help us by opening an issue on that, it would be great !