ptrblck:

1


Im running in a notebook… so there’s no notion of running the script like that. I see what the issue might be there. But I think I handle that. What’s happening for me when I use DataParallel is that the first N-1 GPUs have memory allocated to them, but the program keeps waiting for the Nth GPU to have the requisite memory allocated… Not sure if thats a common issue?