lhoestq:

If you don’t upload a dataset script, then the default dataset builder for .txt file is used (and basically it concatenates all the text data together).


Update from datasets v1.16: now each split is loaded independently based on file names. For example, each file containing “validation” in its name goes into the validation split. The supported patterns are explained in the docs 2