Marathi 9840
Mongolian 7607
Esperanto 6535
Tamil 6224
Urdu 5977
Azerbaijani 5946
Bosnian 5664
Chinese 5534
Malay 5220
Basque 5182
Bengali 4649
Belarusian 4509
Kazakh 3317
Table 9: Language pairs in the TED talks dataset (58
languages, paired with English) with the train-set size
for each pair.Languages
Afrikaans Laothian
Albanian Latin
Amharic Latvian
Arabic Lithuanian
Armenian Luxembourgish*
Azerbaijani Macedonian
Basque Malagasy
Belarusian Malay
Bengali Malayalam
Bosnian Maltese
Bulgarian Maori
Burmese Marathi
Catalan Mongolian
Cebuano Nepali
Chichewa* Norwegian
Chinese Pashto
Corsican* Persian
Croatian Polish
Czech Portuguese
Danish Punjabi
Dutch Romanian
Esperanto Russian
Estonian Samoan*
Finnish Scots Gaelic*
French Serbian
Frisian Sesotho
Galician Shona*
Georgian Sindhi*
German Sinhalese
Greek Slovak
Gujarati Slovenian
Haitian Creole Somali
Multilingual neural machine translation (NMT) enables training a single model
that supports translation from multiple source languages into multiple target
languages. In this paper, we push the limits of multilingual NMT in terms of
number of languages being used. We perform extensive experiments in training
massively multilingual NMT models, translating up to 102 languages to and from
English within a single model. We explore different setups for training such
models and analyze the trade-offs between translation quality and various
modeling decisions. We report results on the publicly available TED talks
multilingual corpus where we show that massively multilingual many-to-many
models are effective in low resource settings, outperforming the previous
state-of-the-art while supporting up to 59 languages. Our experiments on a
large-scale dataset with 102 languages to and from English and up to one
million examples per direction also show promising results, surpassing strong
bilingual baselines and encouraging future work on massively multilingual NMT.
Roee Aharoni Melvin Johnson Orhan Firat