Thank you for your inputs, that was really helpful!
Got the nodes talking to each other.
As I’ve mentioned, I don’t have GPUs installed on these machines. In the ToyModel example, how do I alter these two lines to move the processes to the CPUs of the respective nodes?
    device = torch.device("cuda:0" if torch.cuda.is_available() else "cpu")

    # create model and move it to GPU (need to move to CPU) with id rank
    model = ToyModel().to(rank)
    ddp_model = DDP(model, device_ids=[rank])

Keeps throwing an error that “NVIDIA driver is missing”, I do not intend to use CUDA.