The to() operation is differentiable and Autograd will backpropagate “through” this operation to the corresponding devices. I.e. the gradient calculation for the model on GPU0 will be performed on GPU0 and the same applies for GPU1.
Your approach would thus also work and I wouldn’t expect any difference in the performance etc.