nn.DataParallel will split the inputs before passing them to the forward method and will concatenate each output to the expected complete batch output after the forward pass was done.
If you print the shapes outside of the forward method, you won’t see any difference compared to a single GPU run.
To see the split size, you could add the print statements to the forward method directly.