Multi-Workers distributed training
Hi, does transformers support multi-workers distributed training for bert fine-tuning?
Hi, here are a few resources to get you started:
- [Examples](https://github.com/huggingface/transformers/tree/master/examples)
- [Docs on distributed training](https://huggingface.co/transformers/examples.html#distributed-training-and-mixed-precision)<|||||>> Hi, here are a few resources to get you started:
> 
> * [Examples](https://github.com/huggingface/transformers/tree/master/examples)
> * [Docs on distributed training](https://huggingface.co/transformers/examples.html#distributed-training-and-mixed-precision)

Got it, after I get familiar with pytorch, this problem solved😀