distributed training
why the training args n_gpu is set to 1 when use Trainer's distributed training？
which means only one device is allowed in a node？
and the training parameters printed is calculated with the n_gpus=1.
I want to know what should i do when every node has multi gpus. 
Please use the [forums](https://discuss.huggingface.co/) to ask such questions as we keep issues for bugs and feature requests only.<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md) are likely to be ignored.