Hi!
See https://pytorch.org/docs/stable/distributed.html#environment-variable-initialization 292 for an overview of the env initialization method. Also see the help output of the launch utility (run with --help). You’ll find that you’re silently trying to use the same port on localhost for the processes in a single task to find each other. Specify a different port for each task and it will work.