Training Dataset of GPT-2
What is the training dataset for the pre-trained GPT-2 Model?
The pretrained model is trained on the WebText dataset. It's a collection of documents from outgoing Reddit links that have above 3 karma (ensures quality).<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
