Neubig & Hu 18
baselines 2.7 2.8 16.2 24 11.42
many-to-one 11.7 18.3 29.1 28.3 21.85
Wang et al. 18 11.82 18.71 30.3 28.77 22.4
Ours
many-to-one 11.24 18.28 28.63 26.78 21.23
many-to-many 12.78 21.73 30.65 29.54 23.67
Table 1: X !En test BLEU on the TED Talks corpus,
for the language pairs from Neubig and Hu (2018)
Ar-En De-En He-En It-En Avg.
# of examples 213k 167k 211k 203k 198.5k
baselines 27.84 30.5 34.37 33.64 31.59
many-to-one 25.93 28.87 30.19 32.42 29.35
many-to-many 28.32 32.97 33.18 35.14 32.4
Table 2: X !En test BLEU on the TED Talks corpus,
for language pairs with more than 167k examples
updates ar_many2one ro_many2one nl_many2one de_many2one it_many2one ar de it nl
0 0
Multilingual neural machine translation (NMT) enables training a single model
that supports translation from multiple source languages into multiple target
languages. In this paper, we push the limits of multilingual NMT in terms of
number of languages being used. We perform extensive experiments in training
massively multilingual NMT models, translating up to 102 languages to and from
English within a single model. We explore different setups for training such
models and analyze the trade-offs between translation quality and various
modeling decisions. We report results on the publicly available TED talks
multilingual corpus where we show that massively multilingual many-to-many
models are effective in low resource settings, outperforming the previous
state-of-the-art while supporting up to 59 languages. Our experiments on a
large-scale dataset with 102 languages to and from English and up to one
million examples per direction also show promising results, surpassing strong
bilingual baselines and encouraging future work on massively multilingual NMT.
Roee Aharoni Melvin Johnson Orhan Firat