I used Resnet 50 for a quick toy model to achieve quick result:
Because I trained from nothing, the model can only color a few objects. But I will spend a little bit more time training next month. To answer your question, I suggest you use ptrblck’s way from above.
If you have more question, I think a nice guy, Ptrblck, and others will help you too. If you need some help from me, please feel free to shoot me any questions. If you need my code and data to redo the examples from below, please email me. I don’t have Physical GPU, but I trained it on Colab
Input Data----> Machine Coloring---------> correct color from original images:

image861×765 175 KB


image841×721 175 KB

I may post the code next month after improvement, and so far my repo only has the output. In fact, there are many coloring examples on Github from other people:

  
      
      GitHub
  
  
    

JonathanSum/Coloring-Anime-image-and-other-Deep-Projects 57

Contribute to JonathanSum/Coloring-Anime-image-and-other-Deep-Projects development by creating an account on GitHub.