From other threads I found that,
> `cudnn.benchmark=True` will try different convolution algorithms for each input shape.
So I believe that torch can set the algorithms specifically for each layer individually.
Is there a possibility to set this manually?
From https://core.ac.uk/download/pdf/224976536.pdf I see that we have GEMM, FFT and Winograd.