Thanks for the information. I cannot reproduce this issue on a V100 with CUDA11.2 and am not sure what the PyTorch version 19.09 would refer to.
Are you using an NGC container of this old version? If so, it wouldn’t ship with CUDA11.2, so could you post an update about your setup, please?