It is very hard to root cause your problem by just looking at the commands you have run. I suggest checking out our debugging tools described here 2. They might give you more context about the problem.
Also make sure that you read our documentation on torchrun 1 which is the officially recommended way to start distributed jobs.