Ok, but if your model succesfully overfits on a small sample, this would be at least some signal that your code is working, so I would suggest to try it first.
I’m not familiar with the package you’ve linked, but apparently it’s used to avoid an imbalances GPU memory usage in nn.DataParallel.