Most pre-trained models accept three channels input. The simplest way to handle this is by repeating the single channel 3 times; by, for example, applying the following transform while loading your data:
image_transfrom = transforms.Compose([
           ...
           transforms.Lambda(lambda x: x.repeat(3, 1, 1)),
            ...
            ])