Unfortunately, setting output to CPU results in ValueError: Expected a cuda device, but got: cpu.  Setting output to GPU 3 seems to only collect the loss to that GPU.  Gradients seem to still be gathered in GPU 0.
Reducing batch size won’t work since I am already processing a single sample on each GPU due to the large size of my model.