With the torch.cuda.synchronize() before and after model, here’s what I see:

1080 Ti: 46.9ms per pass
Titan V: 58.4ms per pass

When I repeat the experiment, Titan V is consistently worse.
However, I used torchvision.models.resnet152 instead and ran the same test with synchronize():

1080 Ti: 62.7ms per pass
Titan V: 59.4ms per pass

Titan V is consistently faster by a little bit in this scenario.
With torchvision.models.densenet121, the performance is very comparable:

1080 Ti: 30.0ms per pass
Titan V: 29.8ms per pass