I am trying to parallelize the following network - https://pastebin.com/raw/FgehWHw0 8
by using DataParallel as suggested on the forums as - network = torch.nn.DataParallel(network, device_ids = args.gpus) where network is the a network of the type RNN Encoder and args.gpus is a list of available GPU device IDs.
I keep running into the following error in doing so - https://pastebin.com/raw/0nfmmhkz 13
When I was trying to run this on a single GPU (defauly pytorch setting) I was getting an out of memory error, which made me resort to parallelizing my code.
Is there a reasonable fix?