You could load the pretrained parameters into your model with some code like this:
with torch.no_grad():
    new_model.conv1.weight.copy_(vgg.features[0].weight)
    new_model.conv1.bias.copy_(vgg.features.bias)
    ...

Would that work for you?