You cannot really autocolorize an image. Is there a way for you to change your first cnn to only have 1 input channel? If not you could look into making a custom transform and just copy the image and stack them. Here 9 is a tutorial where it shows what a custom transform looks like.