Can I training an XLM model from scratch by transformers?
How can I pretain XLM by transformers? Any example? Please.
Hey @thomas-li-sjtu, you definitely can. I recommend that you check out [this HF blog post](https://huggingface.co/blog/how-to-train). Although the article doesn't use XLM, the process should roughly look the same.

Also, a gentle reminder to use the [discussion forum](https://discuss.huggingface.co) for inquiries. GitHub Issues is used for bug reports and feature requests!<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.