There is no concept of local processes and remote processes; only the total number of processes through torch.distributed.get_world_size().
To understand if we need add this: what do you need this for?