Loss is high, validation accuracy low( example: Epoch 50: Validation Loss =4.9031, VA=0.0100) . I use the pretrained model like this inside the init function of my model:
        alexnet = models.alexnet(pretrained=True)
        self.features = alexnet.features
        model_dict=self.state_dict()
        pretrained_dict=alexnet.state_dict()
        pretrained_dict= {k: v for k, v in pretrained_dict.items() if k in model_dict}
        model_dict.update(pretrained_dict)
        self.load_state_dict(model_dict)