Input data is a text file with entries differentiated by a newline in the following sequence:
<|startoftext|> sentence1… <|endoftext|>
<|startoftext|> sentence2… <|endoftext|>
<|startoftext|> sentence3… <|endoftext|>

This is the input to the Trainer:

DatasetDict({
train: Dataset({
features: [‘attention_mask’, ‘input_ids’],
num_rows: 25
})
test: Dataset({
features: [‘attention_mask’, ‘input_ids’],
num_rows: 10
})
})