How can I use "accelerate launch" command to run  training job on Multi-GPU?
How can I use "accelerate launch" command to train "run_wav2vec2_pretraining_no_trainer.py" on Multi-GPU?

I found that when i use " accelerate launch run_wav2vec2_pretraining_no_trainer ..." , it would run training on a single GPU.
I also tried "accelerate launch --num_machines 4" command , but still not work

@patrickvonplaten, @anton-l
Before starting the training, I recommend to run `accelerate config` which helps you setting up the multi-gpu training. When running the commend you are asked how many GPUs you want to use and your answer is then stored in a config that will automatically be used by `accelerate launch`. Could you give this a try?<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.