Hi, maybe you guys are interested in this related thread 

  
    
    
    Convert mT5 to HF weights? 🤗Transformers
  
  
    Hi @congcongwang! 
How have you been trying to do it, if I may ask? 
There is a way of doing it for other models, as shown here but T5 is not among them. 
Thank you!