Ok…
The input Variable were not transferred to the GPU, I guess the DataLoader was doing this implicitly. So the cuda problem is solved, thanks !
Any ideas welcomed to use the DataParallel with multiple inputs !