Solved by ptrblck in post #8 
              
              
                Thanks for the code! 
I cannot reproduce the cudnn issue on a 2080 using the 1.8.0+CUDA10.2+cudnn7.6.5 and 1.8.0+CUDA11.1+cudnn8.0.5 conda binaries for all shapes in [1, 32]: 
for bs in torch.arange(1, 33):
    x = torch.randn(bs, 3, 224, 224, device=device)
    out = model(x)
    print(out.device)
…