OK, if you used the pretrained model, you can just load it in the same way as before and load your trained state_dict after it:
import torchvision.models as models

model_ft = models.resnet101(pretrained=False)
model_ft.load_state_dict(torch.load(PATH))