ptrblck:

How different are your input shapes? Are you getting new shapes in each iteration or only in the first couple of iterations?


Hi, thanks for your help! I disabled cudnn by setting cudnn.enable to False in my experiments.
I also used a shallow resnet here, because disabling the flag seems to raise the memory usage.
Now the speed are quite in similar in 1080tis and RTX2080tis, both around 24s~30s for 100 iterations.
My task is similar to image segmentation, the input here is a Lx20 (20 is the feature) tensor and outputs a L*L 0/1 segmentation map. L ranges from 50 to up to 400. Batch size is set to 1,  and I’m getting new shapes in every iteration. ehhh I don’t think resizing the input to a fixed L looks reasonable in my task.