Hey Soufiane,


When you say “my code freezes” do you mean that your process hangs? Unfortunately I haven’t been able to reproduce this issue. And regarding the torchrun script; you are most likely reading the docs of the master branch. torchrun will be part of v1.10 and is simply an alias to python -m torch.distributed.run.


There are some known issues with the launcher scripts in v1.9. I was able to reproduce your problem with stderr not showing up in the log_dir. In the meantime we have fixed most of the issues and a patch release v1.9.1 will be released very soon. Using the latest nightly build, I verified that your script works as expected with proper log output. If this issue is blocking you, I suggest temporarily using a nightly build and migrating to v1.9.1 in a few days once released.


Cheers,
Can