Hi, have you solved the problem? I also encountered the same problem. My code runs quickly on a TITAN XP. After I copied to DGX-1 V100, it is very slow (about 3 times  slower than TITAN XP). By the way, I have set  torch.backends.cudnn.benchmark = True.