BramVanroy:

u can look it up for more information


BramVanroy,
I experimented with nn.DataParallel(model),  For example, if I want to use 2 GPU
but in this method, the entire model copy is copied on both GPUs
I would like to do, half data should be trained on one GPU and another half data on another GPU, eventually I can complete training in less time.
I wonder that is it possible to nn.DataParallel(model) ?