@ptrblck Now it says cuda runtime error (2) : out of memory at /pytorch/torch/lib/THC/generic/THCStorage.cu:66  and Uses only GPU- 0
Does DataParallel executes batches parallely and merges them together ?