I just wanted to compare the workflow with loading a pre-trained model from torchvision. You should use your own model instead.
Here is some pseudo code:
model = Net()
model.load_state_dict(torch.load(PATH))
model.conv_classify = nn.Conv2d(...)
...