The gradients will be reduced to the GPU you are specifying, so you might see a slightly increased memory usage on this device.
The DataLoaders look good. Since you are using GPUs, you should also set pin_memory=True to use the pinned host memory as the GPU cannot access data directly from pageable host memory.