Hi there!
This might be what you’re after: transformers/examples/tensorflow/language-modeling at master · huggingface/transformers · GitHub 6
You’d use the run_clm script for a GPT-2 like model, and the run_mlm script for a BERT-like model.
EDIT: If you’re able to use docker on your machine, you could also use a huggingface image 2 to run that notebook you linked to.