Hey everybody,
The mT5 and improved T5v1.1 models are added:
Improved T5 models (small to large):

google/t5-v1_1-small 37
google/t5-v1_1-base 24
google/t5-v1_1-large 15

and mT5 models (small to large):

google/mt5-small 47
google/mt5-base 25
google/mt5-large 15

are in the model hub Will upload the 3b and 11b versions in the coming days…
I want to start a thread here to collect some fine-tuning results and possibly some notebooks & tips and tricks.
If anyone has fine-tuned a mT5 or T5v1.1 model, it would be awesome to share the results here 
Also, it might be interesting to see whether fp16 is compatible with the new T5 models, cf. with https://github.com/huggingface/transformers/issues/4287 39
I’ll try to allocate some time this week for fine-tuning, but I’m very excited about some possible discussions here.
Tagging some of our power contributors @valhalla @mrm8488 @beltagy @Jung (just FYI  )