Hi,
This link 581 is for torch.backends.cudnn.benchmark.
As for torch.backends.cudnn.deterministic, in my opinion, it can make your experiment reproducible, similar to set random seed to all options where there needs a random seed.