The loss dimension or size won’t be increased, so no changes would be necessary compared to a single GPU run (assuming your model returns an output and you are calculating the loss “outside” of the model).