Solved by Nikronic in post #2 
              
              
                Hi, 
For this, there are different approaches but personally, I would create a class on top of previously defined model which you have weights for. Then add any other layers as another sequential to the new defined model. Something like this: 
pretrained = torchvision.models.alexnet(pretrained=True)…