Thanks for the explanation.
Did you write the DataParallel class yourself or are you using a specific implementation from another repository?
The native nn.DataParallel class shouldn’t take chunk_sizes as its argument, so I’m just wondering which implementation you are using.