How to pretrain the model (like Roberta) again?
I don't want to pretrain the model from scratch. I have some dataset related to my task. I want to pretrain the model from transformers the second time. Could someone give me some advice on how to do it or which document to read?  Thank you!
The authors of the Transformers library wrote a script for this. You can find it under the examples folder -> language modeling [here](https://github.com/huggingface/transformers/tree/master/examples/language-modeling#robertabertdistilbert-and-masked-language-modeling). <|||||>> The authors of the Transformers library wrote a script for this. You can find it under the examples folder -> language modeling [here](https://github.com/huggingface/transformers/tree/master/examples/language-modeling#robertabertdistilbert-and-masked-language-modeling).

Thank you! I will check it out.<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
