Hi,
ONNX allows to compress transformers models and speed up the inference time on CPU and GPU.
Who could share code / notebook to convert mT5 and ByT5 models to ONNX format?
There is the library fastT5 1 of @kira for T5 conversion (great!) but it has not been updated to the latest version of transformers and therefore, it does not accept mT5 and ByT5 models.
Thanks.
List of topicos about this subject:

Speeding up T5 inference
Boost inference speed of T5 models up to 5X & reduce the model size by 3X 1
Questions on distilling [from] T5 1

List of online documents about this subject:

Exporting transformers models 2
Notebook: onnx_t5.ipynb 4 from @valhalla

Notebook:  onnx-export.ipynb 1