I want to know too. I’m training with a data that is not divisible by the minibatch size, so the last batch has a number that cannot be divided by the number of GPUs. And I’m getting an error when I tried to use DataParallel.