I was wondering if it is possible to update the resnet part of deeplabv3 with the pretrain weights of resnet50?
import torch
import torchvision
import torchvision.models as models

model = models.segmentation.deeplabv3_resnet50(num_classes=21, pretrained=False)
res50 = torchvision.models.resnet50(pretrained=False)

doing something like below is not working correctly:
model.backbone.load_state_dict(res50.state_dict(), strict=False)
_IncompatibleKeys(missing_keys=[], unexpected_keys=['fc.weight', 'fc.bias'])