I guess, maybe the performance of this pretrained vgg16 model is worse than the original oxford vgg16 model.
You can try to convert the original vgg16 model into pytorch format, and change the preprocessing step accordingly.