You can incorporate any pre-trained classification model like (VGG, Alexnet, resnet, etc.) as an encoder and build the corresponding decoder. There is a good pytorch library for this Pytorch Segmentation Models 2