T5 only has been trained on a specific set of prefixes. You can find a list here:
https://arxiv.org/pdf/1910.10683.pdf 4 (starting at page 47)
That said, you can just finetune without a prefix (or with a custom prefix) and it should still work out.