Solved by chenglu in post #5 
              
              
                You can still using the pretrained weights, here’s some code: 
import torch
import torch.utils.model_zoo as model_zoo
from torchvision.models.vgg import VGG, make_layers, cfg, vgg16

class MyVgg(VGG):

    def __init__(self):
        super().__init__(make_layers(cfg['D']))

    def forward(self, x):…