I’m also looking for something like this.
From the docs 1

Most use cases involving batched inputs and multiple GPUs should default to using DataParallel to utilize more than one GPU. Even with the GIL, a single Python process can saturate multiple GPUs.
As of version 0.1.9, large numbers of GPUs (8+) might not be fully utilized. However, this is a known issue that is under active development. As always, test your use case.

That’s essentially what’s happening for me. I have a computer with many GPUs and the CPU becomes the bottleneck