Sorry, I might have looked at another post and saw pretrained=False in the code snippet.
You are right that you are already using a pretrained model, so skip this part and check the last issue (i.e. replacing the model.fc layer with nn.Sequential).