one-to-many 12.08 9.92 15.6 31.39 20.01 33 31.06 28.43 17.67 17.68 21.68
many-to-many 10.57 9.84 14.3 28.48 17.91 30.39 29.67 26.23 18.15 15.58 20.11
Table 6: En !X test BLEU on the 103-language corpus
3.2 Results
Table 5 describes the results when translating into
English. First, we can see that both multilingual
models perform better than the baselines in terms
of average BLEU. This shows that massively multilingual many-to-many models can work well in
realistic settings with millions of training examples, 102 languages and 204 jointly trained directions to-and-from English. Looking more closely,
we note several different behaviors in comparison
to the low-resource experiments on the TED Talks
corpus. First, the many-to-one model here performs better than the many-to-many model. This
shows that the previous result was indeed due to
the pathologies of the low-resource dataset; when
the training data is large enough and not multiway-parallel there is no overﬁtting in the many-toone model, and it outperforms the many-to-many
model in most cases while they are trained identically.
Multilingual neural machine translation (NMT) enables training a single model
that supports translation from multiple source languages into multiple target
languages. In this paper, we push the limits of multilingual NMT in terms of
number of languages being used. We perform extensive experiments in training
massively multilingual NMT models, translating up to 102 languages to and from
English within a single model. We explore different setups for training such
models and analyze the trade-offs between translation quality and various
modeling decisions. We report results on the publicly available TED talks
multilingual corpus where we show that massively multilingual many-to-many
models are effective in low resource settings, outperforming the previous
state-of-the-art while supporting up to 59 languages. Our experiments on a
large-scale dataset with 102 languages to and from English and up to one
million examples per direction also show promising results, surpassing strong
bilingual baselines and encouraging future work on massively multilingual NMT.
Roee Aharoni Melvin Johnson Orhan Firat