Deterministic algorithms are known to be potentially slow and apparently dgrad2d_alg1_1 was the one suitable for your device.
Using cudnn.benchmark=True wouldn’t change it, as the kernel selection is in itself non-deterministic and should thus be disabled.