I am not aware of public notebooks regarding training Huggingface’s TFGPT2, but we have public notebooks of training TFT5 and TFXLM-R , which should give you some ideas
TF-T5

  
      
      colab.research.google.com
  
  
    

Google Colaboratory 3



  
  
    
    
  
  


TF-XLM-R
https://www.kaggle.com/riblidezso/finetune-xlm-roberta-on-jigsaw-test-data-with-mlm 3