I tried a bunch of the combos.

Commenting out model = model.to(device) gets me Broadcast not implemented for CPUTensors...

Looking at the source now, if all outputs have to be gathered at one device, wouldn’t that increase the usage on device_ids[0] anyway? Is there anyway to circumvent this?