A layman wants to train DistilBERT
    I want to train DistilBERT, but I don't  know how to get the training data.
In the article, it describes the training data as a concatenation of Toronto Book Corpus and English Wikipedia (same training data as the English version of BERT). So how can I get it?
![image](https://user-images.githubusercontent.com/38905736/98760883-378c8f00-240f-11eb-881a-2048e2967617.png)


[https://github.com/huggingface/transformers/blob/1ab8dc44b3d84ed1894f5b6a6fab58fb39298fc7/examples/distillation/README.md](url)
[https://github.com/google-research/bert](url)

In this url, I find some files.
![image](https://user-images.githubusercontent.com/38905736/98761374-3c057780-2410-11eb-8028-4f896e86aa24.png)

But I don't whether they are the data which used to be the training data of distilbert.
And the distilbert model need "dump.txt ", not ".json", whether the data we need is included in it?<|||||>I find a text in the goole project bert.
[https://github.com/google-research/bert/blob/master/sample_text.txt](url)
Is it the training data of this project?<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
