Hellow,I am sure the trouble is .eval()
I make a little trick for convenience that I download  the source of torchvision.models .And I remove the nn.MaxPool2d() in vgg_16(pretrained=True) model,then I use F.maxpool2d() in  forward process. I guess this is the root of my trouble when I use .eval().May be?