I got the DataParallel() example for multi-GPU working successfully for my model.
However, I happen to have a 64-core Xeon Phi CPU, and I can’t stand looking at it sitting idle.  How can I saturate the CPU by assigning it some work?  In other words, can I split the workload on GPU0, GPU1, and CPU0-255 and sum the gradients on CPU?
Thank you!