nn.DataParallel might create an imbalanced memory usage as described here.
This could yield an out of memory issue on one device, which would stop the script execution.
You could lower the batch size (if it’s not already 1 per device) and rerun the script to check the device usage.