how to train RoBERTa from scratch
## ❓ Questions & Help

<!-- A clear and concise description of the question. -->
I want to train RoBERTa model from scratch on different language. Is there any implementation available here to do this?
https://github.com/pytorch/fairseq/blob/master/examples/roberta/README.pretraining.md<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
<|||||>You can now leave `--model_name_or_path` to None in `run_language_modeling.py` to train a model from scratch.

See also https://huggingface.co/blog/how-to-train<|||||>When I put new --config_name and --tokenizer_name. It shows me that 
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
Anyone can help me?