Hi,
T5 is an encoder-decoder model. You can only use the run_mlm.py and run_clm.py scripts for encoder-only models like BERT and RoBERTA.
You can fine-tune T5 for text generation with the run_summarization.py script 6 (for summarization) or the run_translation.py script 8 (for translation).