Hi,
I have a Colab notebook on how to fine-tune T5 on a custom dataset here: GitHub - NielsRogge/Transformers-Tutorials: This repository contains demos I made with the Transformer 39
Let me know if it helps.