Hi, thank you for your answer. Regarding your code, when we run the code isn’t it needed to give the gpu index? How dose coed understand on which gpus should run the process.
And my second question is a bout num_replicas, shouldn’t it be equal to num_process?