generative model chooses to (partially) translate its prediction into the wrong language. All of the code and model
checkpoints used in this work are publicly available.
Note: mT5 was only pre-trained on mC4 excluding any supervised training.
Therefore, this model has to be fine-tuned before it is useable on a downstream task, unlike the original T5 model.
Since mT5 was pre-trained unsupervisedly, there's no real advantage to using a task prefix during single-task
fine-tuning. If you are doing multi-task fine-tuning, you should use a prefix.
Google has released the following variants:
google/mt5-small
google/mt5-base
google/mt5-large
google/mt5-xl
google/mt5-xxl.
This model was contributed by patrickvonplaten. The original code can be
found here.
MT5Config
[[autodoc]] MT5Config
MT5Tokenizer
