Sorry for my late response and thank you for the reply!
I pinned the trigger of this warning. It happens if I set num_workers > 0 in torch.utils.data.DataLoader, instead of being caused by nn.DataParallel().
Any idea how to fix it? Is it probably due to that I set torch.multiprocessing.set_start_method('spawn', force=True)?