If I’m not mistaken torch::nn::parallel::data_parallel would be the equivalent to nn.DataParallel in the Python frontend and in case you would like to use DistributedDataParallel feel free to add your use case in this poll 8.