Arabic 214111
Hebrew 211819
Russian 208458
Korean 205640
Italian 204503
Japanese 204090
Chinese-Taiwan 202646
Chinese-China 199855
Spanish 196026
French 192304
Portuguese-Brazil 184755
Dutch 183767
Turkish 182470
Romanian 180484
Polish 176169
Bulgarian 174444
Vietnamese 171995
German 167888
Persian 150965
Hungarian 147219
Serbian 136898
Greek 134327
Croatian 122091
Ukrainian 108495
Czech 103093
Thai 98064
Indonesian 87406
Slovak 61470
Swedish 56647
Portuguese 51785
Danish 44940
Albanian 44525
Lithuanian 41919
Macedonian 25335
Finnish 24222
Burmese 21497
Armenian 21360
French-Canadian 19870
Slovenian 19831
Hindi 18798
Norwegian 15825
Georgian 13193
Estonian 10738
Kurdish 10371
Galician 10017
Marathi 9840
Mongolian 7607
Esperanto 6535
Tamil 6224
Urdu 5977
Azerbaijani 5946
Multilingual neural machine translation (NMT) enables training a single model
that supports translation from multiple source languages into multiple target
languages. In this paper, we push the limits of multilingual NMT in terms of
number of languages being used. We perform extensive experiments in training
massively multilingual NMT models, translating up to 102 languages to and from
English within a single model. We explore different setups for training such
models and analyze the trade-offs between translation quality and various
modeling decisions. We report results on the publicly available TED talks
multilingual corpus where we show that massively multilingual many-to-many
models are effective in low resource settings, outperforming the previous
state-of-the-art while supporting up to 59 languages. Our experiments on a
large-scale dataset with 102 languages to and from English and up to one
million examples per direction also show promising results, surpassing strong
bilingual baselines and encouraging future work on massively multilingual NMT.
Roee Aharoni Melvin Johnson Orhan Firat