many-to-many 3.9 7.24 23.78 21.83 14.19
En-Ar En-De En-He En-It Avg.
# of examples 213k 167k 211k 203k 198.5k
baselines 12.95 23.31 23.66 30.33 22.56
one-to-many 16.67 30.54 27.62 35.89 27.68
many-to-many 14.25 27.95 24.16 33.26 24.9
Table 3: En !X test BLEU on the TED Talks corpus
resource setting the baselines have very few training examples to outperform the many-to-one models, while in the higher resource setting they have
access to more training data. This corroborates the
results of Gu et al. (2018) that showed the sensitivity of such models to similar low resource conditions and the improvements gained from using
many-to-one models (however with much fewer
language pairs).
Table 3 shows the results of our massively
multilingual models and bilingual baselines when
evaluated out-of-English. In this case we see an
opposite trend: the many-to-many model performs
worse than the one-to-many model by 2.53 BLEU
on average. While previous works (Wang et al.,
Multilingual neural machine translation (NMT) enables training a single model
that supports translation from multiple source languages into multiple target
languages. In this paper, we push the limits of multilingual NMT in terms of
number of languages being used. We perform extensive experiments in training
massively multilingual NMT models, translating up to 102 languages to and from
English within a single model. We explore different setups for training such
models and analyze the trade-offs between translation quality and various
modeling decisions. We report results on the publicly available TED talks
multilingual corpus where we show that massively multilingual many-to-many
models are effective in low resource settings, outperforming the previous
state-of-the-art while supporting up to 59 languages. Our experiments on a
large-scale dataset with 102 languages to and from English and up to one
million examples per direction also show promising results, surpassing strong
bilingual baselines and encouraging future work on massively multilingual NMT.
Roee Aharoni Melvin Johnson Orhan Firat