Ping @ptrblck , any fixes on what could be done? the current setup is very time consuming given that we can train only on just one GPU. If you could please suggest a version of Nvidia-driver, CUDA, where nn.DataParallel or nn.DistributedDataParallel is known to work on A100 GPUs, that will be very much appreciated. Thank you