Hi,
In the code above, did I place the lines of torch.manual_seed ... in the correct locations? I used torch.distributed to manipulate multi-gpu training. Do I need to move these lines after dist.init_process_group or other locations?