@ptrblck I am facing a related issue: RuntimeError: CUDA error: initialization error when calling torch.distributed.init_process_group using torch multiprocessing 23   Appreciate if you could take a look and provide me some inputs.