hey @imtrying, the examples have recently been split into the different frameworks that transformers supports, so you can find the script for language modeling in pytorch here: transformers/examples/pytorch/language-modeling at master · huggingface/transformers · GitHub 10



 imtrying:

and im still confused about the train_dataset and eval_dataset, because all i have is corpus of .txt .


which part is causing you confusion? how to create the datasets or something else?