I am not an expert, but just today I was reading a blog post that mentions something about that.
They use MSELoss.
Here is the blog post:
https://towardsdatascience.com/colorizing-black-white-images-with-u-net-and-conditional-gan-a-tutorial-81b2df111cd8 1
I hope it helps.