Could you disable cudnn via torch.backends.cudnn.enabled = False and rerun the check?
If the performance numbers are closer to each other, then most likely cudnn’s default algorithm for the Pascal architecture is slower than for Volta.
How different are your input shapes? Are you getting new shapes in each iteration or only in the first couple of iterations?