In your auxillary model that you add to the VGG19 pretrained model. You should add these layers at the start.
import torch
batch_size = 16
input = torch.randn(batch_size,256,1,1)
input = input.squeeze(3).squeeze(2).view(-1)