If you want to make use of a pretrained network, consider feeding your grayscale image as RGB image to the network, by pasting your grayscale information to all three channels. There might be some clever variants of this technique, Jeremy Howard from fast.ai talked about this a bit in his lectures, unfortunately I don’t remember in which lecture / timestamp exactly.