Hi @ptrblck , I built pytorch from source using CUDA11.1 and cudnn8.1.1. But the problem still exists.
I find that when the code is executed on 3080, GPU-Util is 100%. However, it is 20% when the code is executed on 2080.
The snapshot (on 3080):

image1750×324 31.6 KB