Hi @antspy, I encounter the same problem as yours. In my case, I found loss.backward() is 5 times slower in V100 than in TITAN XP. Did you solve the problem. Could you provide any suggestions? Thank you.
My environment settings are:

anaconda;
python 3.6.6
pytorch 1.0
cuda 10.0
cudnn 7.4.2