This might be related: How to train TFT5ForConditionalGeneration model? 72
Okey, I will start working on a T5 TF notebook showing how T5 can be fine-tuned on CNN / Daily Mail using the TF Trainer this week.