In my case, since I’d like to get deterministic results, I have to set torch.backends.cudnn.enabled = False, which shows much slow performance than using CUDNN.
I’d like to use CUDNN libraries for deterministic modules but not for non-deterministic modules such as CNN libraries. If I can choose backends for each module, I would be able to get some degree of speedup while keeping determinic results.
You don’t really have a plan to allow manually choosing backends?