Right now there’s no way to pick which layers will use cuDNN and which not. It will be automatically picked, based on what’s the fastest option. There’s only a global switch torch.backends.cudnn.enabled that you can set to False to globally disable cuDNN.
Just out of curiosity, what’s the reason why you need to select a particular backend?