pytorch marian seq2seq en ca es os eo ro fy cy is lb su an sq fr ht rm cv ig am eu tr ps af ny ch uk sl lt tk sg ar lg bg be ka gd ja si br mh km th ty rw te mk or wo kl mr ru yo hu fo zh ti co ee oc sn mt ts pl gl nb bn tt bo lo id gn nv hy kn to io so vi da fj gv sm nl mi pt hi se as ta et kw ga sv ln na mn gu wa lv jv el my ba it hr ur ce nn fi mg rn xh ab de cs he zu yi ml mul transformers translation license:apache-2.0 text2text-generation
.gitattributes README.md config.json metadata.json pytorch_model.bin source.spm target.spm tokenizer_config.json vocab.json
---
language: 
- en
- ca
- es
- os
- eo
- ro
- fy
- cy
- is
- lb
- su
- an
- sq
- fr
- ht
- rm
- cv
- ig
- am
- eu
- tr
- ps
- af
- ny
- ch
- uk
- sl
- lt
- tk
- sg
- ar
- lg
- bg
- be
- ka
- gd
- ja
- si
- br
- mh
- km
- th
- ty
- rw
- te
- mk
- or
- wo
- kl
- mr
- ru
- yo
- hu
- fo
- zh
- ti
- co
- ee
- oc
- sn
- mt
- ts
- pl
- gl
- nb
- bn
- tt
- bo
- lo
- id
- gn
- nv
- hy
- kn
- to
- io
- so
- vi
- da
- fj
- gv
- sm
- nl
- mi
- pt
- hi
- se
- as
- ta
- et
- kw
- ga
- sv
- ln
- na
- mn
- gu
- wa
- lv
- jv
- el
- my
- ba
- it
- hr
- ur
- ce
- nn
- fi
- mg
- rn
- xh
- ab
- de
- cs
- he
- zu
- yi
- ml
- mul

tags:
- translation

license: apache-2.0
---

### eng-mul

* source group: English 
* target group: Multiple languages 
*  OPUS readme: [eng-mul](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/eng-mul/README.md)

*  model: transformer
* source language(s): eng
* target language(s): abk acm ady afb afh_Latn afr akl_Latn aln amh ang_Latn apc ara arg arq ary arz asm ast avk_Latn awa aze_Latn bak bam_Latn bel bel_Latn ben bho bod bos_Latn bre brx brx_Latn bul bul_Latn cat ceb ces cha che chr chv cjy_Hans cjy_Hant cmn cmn_Hans cmn_Hant cor cos crh crh_Latn csb_Latn cym dan deu dsb dtp dws_Latn egl ell enm_Latn epo est eus ewe ext fao fij fin fkv_Latn fra frm_Latn frr fry fuc fuv gan gcf_Latn gil gla gle glg glv gom gos got_Goth grc_Grek grn gsw guj hat hau_Latn haw heb hif_Latn hil hin hnj_Latn hoc hoc_Latn hrv hsb hun hye iba ibo ido ido_Latn ike_Latn ile_Latn ilo ina_Latn ind isl ita izh jav jav_Java jbo jbo_Cyrl jbo_Latn jdt_Cyrl jpn kab kal kan kat kaz_Cyrl kaz_Latn kek_Latn kha khm khm_Latn kin kir_Cyrl kjh kpv krl ksh kum kur_Arab kur_Latn lad lad_Latn lao lat_Latn lav ldn_Latn lfn_Cyrl lfn_Latn lij lin lit liv_Latn lkt lld_Latn lmo ltg ltz lug lzh lzh_Hans mad mah mai mal mar max_Latn mdf mfe mhr mic min mkd mlg mlt mnw moh mon mri mwl mww mya myv nan nau nav nds niu nld nno nob nob_Hebr nog non_Latn nov_Latn npi nya oci ori orv_Cyrl oss ota_Arab ota_Latn pag pan_Guru pap pau pdc pes pes_Latn pes_Thaa pms pnb pol por ppl_Latn prg_Latn pus quc qya qya_Latn rap rif_Latn roh rom ron rue run rus sag sah san_Deva scn sco sgs shs_Latn shy_Latn sin sjn_Latn slv sma sme smo sna snd_Arab som spa sqi srp_Cyrl srp_Latn stq sun swe swg swh tah tam tat tat_Arab tat_Latn tel tet tgk_Cyrl tha tir tlh_Latn tly_Latn tmw_Latn toi_Latn ton tpw_Latn tso tuk tuk_Latn tur tvl tyv tzl tzl_Latn udm uig_Arab uig_Cyrl ukr umb urd uzb_Cyrl uzb_Latn vec vie vie_Hani vol_Latn vro war wln wol wuu xal xho yid yor yue yue_Hans yue_Hant zho zho_Hans zho_Hant zlm_Latn zsm_Latn zul zza
* model: transformer
* pre-processing: normalization + SentencePiece (spm32k,spm32k)
* a sentence initial language token is required in the form of `>>id<<` (id = valid target language ID)
* download original weights: [opus2m-2020-08-01.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-mul/opus2m-2020-08-01.zip)
* test set translations: [opus2m-2020-08-01.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-mul/opus2m-2020-08-01.test.txt)
* test set scores: [opus2m-2020-08-01.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/eng-mul/opus2m-2020-08-01.eval.txt)

## Benchmarks

| testset               | BLEU  | chr-F |
|-----------------------|-------|-------|
| newsdev2014-enghin.eng.hin 	| 5.0 	| 0.288 |
| newsdev2015-enfi-engfin.eng.fin 	| 9.3 	| 0.418 |
| newsdev2016-enro-engron.eng.ron 	| 17.2 	| 0.488 |
| newsdev2016-entr-engtur.eng.tur 	| 8.2 	| 0.402 |
| newsdev2017-enlv-englav.eng.lav 	| 12.9 	| 0.444 |
| newsdev2017-enzh-engzho.eng.zho 	| 17.6 	| 0.170 |
| newsdev2018-enet-engest.eng.est 	| 10.9 	| 0.423 |
| newsdev2019-engu-engguj.eng.guj 	| 5.2 	| 0.284 |
| newsdev2019-enlt-englit.eng.lit 	| 11.0 	| 0.431 |
| newsdiscussdev2015-enfr-engfra.eng.fra 	| 22.6 	| 0.521 |
| newsdiscusstest2015-enfr-engfra.eng.fra 	| 25.9 	| 0.546 |
| newssyscomb2009-engces.eng.ces 	| 10.3 	| 0.394 |
| newssyscomb2009-engdeu.eng.deu 	| 13.3 	| 0.459 |
| newssyscomb2009-engfra.eng.fra 	| 21.5 	| 0.522 |
| newssyscomb2009-enghun.eng.hun 	| 8.1 	| 0.371 |
| newssyscomb2009-engita.eng.ita 	| 22.1 	| 0.540 |
| newssyscomb2009-engspa.eng.spa 	| 23.8 	| 0.531 |
| news-test2008-engces.eng.ces 	| 9.0 	| 0.376 |
| news-test2008-engdeu.eng.deu 	| 14.2 	| 0.451 |
| news-test2008-engfra.eng.fra 	| 19.8 	| 0.500 |
| news-test2008-engspa.eng.spa 	| 22.8 	| 0.518 |
| newstest2009-engces.eng.ces 	| 9.8 	| 0.392 |
| newstest2009-engdeu.eng.deu 	| 13.7 	| 0.454 |
| newstest2009-engfra.eng.fra 	| 20.7 	| 0.514 |
| newstest2009-enghun.eng.hun 	| 8.4 	| 0.370 |
| newstest2009-engita.eng.ita 	| 22.4 	| 0.538 |
| newstest2009-engspa.eng.spa 	| 23.5 	| 0.532 |
| newstest2010-engces.eng.ces 	| 10.0 	| 0.393 |
| newstest2010-engdeu.eng.deu 	| 15.2 	| 0.463 |
| newstest2010-engfra.eng.fra 	| 22.0 	| 0.524 |
| newstest2010-engspa.eng.spa 	| 27.2 	| 0.556 |
| newstest2011-engces.eng.ces 	| 10.8 	| 0.392 |
| newstest2011-engdeu.eng.deu 	| 14.2 	| 0.449 |
| newstest2011-engfra.eng.fra 	| 24.3 	| 0.544 |
| newstest2011-engspa.eng.spa 	| 28.3 	| 0.559 |
| newstest2012-engces.eng.ces 	| 9.9 	| 0.377 |
| newstest2012-engdeu.eng.deu 	| 14.3 	| 0.449 |
| newstest2012-engfra.eng.fra 	| 23.2 	| 0.530 |
| newstest2012-engrus.eng.rus 	| 16.0 	| 0.463 |
| newstest2012-engspa.eng.spa 	| 27.8 	| 0.555 |
| newstest2013-engces.eng.ces 	| 11.0 	| 0.392 |
| newstest2013-engdeu.eng.deu 	| 16.4 	| 0.469 |
| newstest2013-engfra.eng.fra 	| 22.6 	| 0.515 |
| newstest2013-engrus.eng.rus 	| 12.1 	| 0.414 |
| newstest2013-engspa.eng.spa 	| 24.9 	| 0.532 |
| newstest2014-hien-enghin.eng.hin 	| 7.2 	| 0.311 |
| newstest2015-encs-engces.eng.ces 	| 10.9 	| 0.396 |
| newstest2015-ende-engdeu.eng.deu 	| 18.3 	| 0.490 |
| newstest2015-enfi-engfin.eng.fin 	| 10.1 	| 0.421 |
| newstest2015-enru-engrus.eng.rus 	| 14.5 	| 0.445 |
| newstest2016-encs-engces.eng.ces 	| 12.2 	| 0.408 |
| newstest2016-ende-engdeu.eng.deu 	| 21.4 	| 0.517 |
| newstest2016-enfi-engfin.eng.fin 	| 11.2 	| 0.435 |
| newstest2016-enro-engron.eng.ron 	| 16.6 	| 0.472 |
| newstest2016-enru-engrus.eng.rus 	| 13.4 	| 0.435 |
| newstest2016-entr-engtur.eng.tur 	| 8.1 	| 0.385 |
| newstest2017-encs-engces.eng.ces 	| 9.6 	| 0.377 |
| newstest2017-ende-engdeu.eng.deu 	| 17.9 	| 0.482 |
| newstest2017-enfi-engfin.eng.fin 	| 11.8 	| 0.440 |
| newstest2017-enlv-englav.eng.lav 	| 9.6 	| 0.412 |
| newstest2017-enru-engrus.eng.rus 	| 14.1 	| 0.446 |
| newstest2017-entr-engtur.eng.tur 	| 8.0 	| 0.378 |
| newstest2017-enzh-engzho.eng.zho 	| 16.8 	| 0.175 |
| newstest2018-encs-engces.eng.ces 	| 9.8 	| 0.380 |
| newstest2018-ende-engdeu.eng.deu 	| 23.8 	| 0.536 |
| newstest2018-enet-engest.eng.est 	| 11.8 	| 0.433 |
| newstest2018-enfi-engfin.eng.fin 	| 7.8 	| 0.398 |
| newstest2018-enru-engrus.eng.rus 	| 12.2 	| 0.434 |
| newstest2018-entr-engtur.eng.tur 	| 7.5 	| 0.383 |
| newstest2018-enzh-engzho.eng.zho 	| 18.3 	| 0.179 |
| newstest2019-encs-engces.eng.ces 	| 10.7 	| 0.389 |
| newstest2019-ende-engdeu.eng.deu 	| 21.0 	| 0.512 |
| newstest2019-enfi-engfin.eng.fin 	| 10.4 	| 0.420 |
| newstest2019-engu-engguj.eng.guj 	| 5.8 	| 0.297 |
| newstest2019-enlt-englit.eng.lit 	| 8.0 	| 0.388 |
| newstest2019-enru-engrus.eng.rus 	| 13.0 	| 0.415 |
| newstest2019-enzh-engzho.eng.zho 	| 15.0 	| 0.192 |
| newstestB2016-enfi-engfin.eng.fin 	| 9.0 	| 0.414 |
| newstestB2017-enfi-engfin.eng.fin 	| 9.5 	| 0.415 |
| Tatoeba-test.eng-abk.eng.abk 	| 4.2 	| 0.275 |
| Tatoeba-test.eng-ady.eng.ady 	| 0.4 	| 0.006 |
| Tatoeba-test.eng-afh.eng.afh 	| 1.0 	| 0.058 |
| Tatoeba-test.eng-afr.eng.afr 	| 47.0 	| 0.663 |
| Tatoeba-test.eng-akl.eng.akl 	| 2.7 	| 0.080 |
| Tatoeba-test.eng-amh.eng.amh 	| 8.5 	| 0.455 |
| Tatoeba-test.eng-ang.eng.ang 	| 6.2 	| 0.138 |
| Tatoeba-test.eng-ara.eng.ara 	| 6.3 	| 0.325 |
| Tatoeba-test.eng-arg.eng.arg 	| 1.5 	| 0.107 |
| Tatoeba-test.eng-asm.eng.asm 	| 2.1 	| 0.265 |
| Tatoeba-test.eng-ast.eng.ast 	| 15.7 	| 0.393 |
| Tatoeba-test.eng-avk.eng.avk 	| 0.2 	| 0.095 |
| Tatoeba-test.eng-awa.eng.awa 	| 0.1 	| 0.002 |
| Tatoeba-test.eng-aze.eng.aze 	| 19.0 	| 0.500 |
| Tatoeba-test.eng-bak.eng.bak 	| 12.7 	| 0.379 |
| Tatoeba-test.eng-bam.eng.bam 	| 8.3 	| 0.037 |
| Tatoeba-test.eng-bel.eng.bel 	| 13.5 	| 0.396 |
| Tatoeba-test.eng-ben.eng.ben 	| 10.0 	| 0.383 |
| Tatoeba-test.eng-bho.eng.bho 	| 0.1 	| 0.003 |
| Tatoeba-test.eng-bod.eng.bod 	| 0.0 	| 0.147 |
| Tatoeba-test.eng-bre.eng.bre 	| 7.6 	| 0.275 |
| Tatoeba-test.eng-brx.eng.brx 	| 0.8 	| 0.060 |
| Tatoeba-test.eng-bul.eng.bul 	| 32.1 	| 0.542 |
| Tatoeba-test.eng-cat.eng.cat 	| 37.0 	| 0.595 |
| Tatoeba-test.eng-ceb.eng.ceb 	| 9.6 	| 0.409 |
| Tatoeba-test.eng-ces.eng.ces 	| 24.0 	| 0.475 |
| Tatoeba-test.eng-cha.eng.cha 	| 3.9 	| 0.228 |
| Tatoeba-test.eng-che.eng.che 	| 0.7 	| 0.013 |
| Tatoeba-test.eng-chm.eng.chm 	| 2.6 	| 0.212 |
| Tatoeba-test.eng-chr.eng.chr 	| 6.0 	| 0.190 |
| Tatoeba-test.eng-chv.eng.chv 	| 6.5 	| 0.369 |
| Tatoeba-test.eng-cor.eng.cor 	| 0.9 	| 0.086 |
| Tatoeba-test.eng-cos.eng.cos 	| 4.2 	| 0.174 |
| Tatoeba-test.eng-crh.eng.crh 	| 9.9 	| 0.361 |
| Tatoeba-test.eng-csb.eng.csb 	| 3.4 	| 0.230 |
| Tatoeba-test.eng-cym.eng.cym 	| 18.0 	| 0.418 |
| Tatoeba-test.eng-dan.eng.dan 	| 42.5 	| 0.624 |
| Tatoeba-test.eng-deu.eng.deu 	| 25.2 	| 0.505 |
| Tatoeba-test.eng-dsb.eng.dsb 	| 0.9 	| 0.121 |
| Tatoeba-test.eng-dtp.eng.dtp 	| 0.3 	| 0.084 |
| Tatoeba-test.eng-dws.eng.dws 	| 0.2 	| 0.040 |
| Tatoeba-test.eng-egl.eng.egl 	| 0.4 	| 0.085 |
| Tatoeba-test.eng-ell.eng.ell 	| 28.7 	| 0.543 |
| Tatoeba-test.eng-enm.eng.enm 	| 3.3 	| 0.295 |
| Tatoeba-test.eng-epo.eng.epo 	| 33.4 	| 0.570 |
| Tatoeba-test.eng-est.eng.est 	| 30.3 	| 0.545 |
| Tatoeba-test.eng-eus.eng.eus 	| 18.5 	| 0.486 |
| Tatoeba-test.eng-ewe.eng.ewe 	| 6.8 	| 0.272 |
| Tatoeba-test.eng-ext.eng.ext 	| 5.0 	| 0.228 |
| Tatoeba-test.eng-fao.eng.fao 	| 5.2 	| 0.277 |
| Tatoeba-test.eng-fas.eng.fas 	| 6.9 	| 0.265 |
| Tatoeba-test.eng-fij.eng.fij 	| 31.5 	| 0.365 |
| Tatoeba-test.eng-fin.eng.fin 	| 18.5 	| 0.459 |
| Tatoeba-test.eng-fkv.eng.fkv 	| 0.9 	| 0.132 |
| Tatoeba-test.eng-fra.eng.fra 	| 31.5 	| 0.546 |
| Tatoeba-test.eng-frm.eng.frm 	| 0.9 	| 0.128 |
| Tatoeba-test.eng-frr.eng.frr 	| 3.0 	| 0.025 |
| Tatoeba-test.eng-fry.eng.fry 	| 14.4 	| 0.387 |
| Tatoeba-test.eng-ful.eng.ful 	| 0.4 	| 0.061 |
| Tatoeba-test.eng-gcf.eng.gcf 	| 0.3 	| 0.075 |
| Tatoeba-test.eng-gil.eng.gil 	| 47.4 	| 0.706 |
| Tatoeba-test.eng-gla.eng.gla 	| 10.9 	| 0.341 |
| Tatoeba-test.eng-gle.eng.gle 	| 26.8 	| 0.493 |
| Tatoeba-test.eng-glg.eng.glg 	| 32.5 	| 0.565 |
| Tatoeba-test.eng-glv.eng.glv 	| 21.5 	| 0.395 |
| Tatoeba-test.eng-gos.eng.gos 	| 0.3 	| 0.124 |
| Tatoeba-test.eng-got.eng.got 	| 0.2 	| 0.010 |
| Tatoeba-test.eng-grc.eng.grc 	| 0.0 	| 0.005 |
| Tatoeba-test.eng-grn.eng.grn 	| 1.5 	| 0.129 |
| Tatoeba-test.eng-gsw.eng.gsw 	| 0.6 	| 0.106 |
| Tatoeba-test.eng-guj.eng.guj 	| 15.4 	| 0.347 |
| Tatoeba-test.eng-hat.eng.hat 	| 31.1 	| 0.527 |
| Tatoeba-test.eng-hau.eng.hau 	| 6.5 	| 0.385 |
| Tatoeba-test.eng-haw.eng.haw 	| 0.2 	| 0.066 |
| Tatoeba-test.eng-hbs.eng.hbs 	| 28.7 	| 0.531 |
| Tatoeba-test.eng-heb.eng.heb 	| 21.3 	| 0.443 |
| Tatoeba-test.eng-hif.eng.hif 	| 2.8 	| 0.268 |
| Tatoeba-test.eng-hil.eng.hil 	| 12.0 	| 0.463 |
| Tatoeba-test.eng-hin.eng.hin 	| 13.0 	| 0.401 |
| Tatoeba-test.eng-hmn.eng.hmn 	| 0.2 	| 0.073 |
| Tatoeba-test.eng-hoc.eng.hoc 	| 0.2 	| 0.077 |
| Tatoeba-test.eng-hsb.eng.hsb 	| 5.7 	| 0.308 |
| Tatoeba-test.eng-hun.eng.hun 	| 17.1 	| 0.431 |
| Tatoeba-test.eng-hye.eng.hye 	| 15.0 	| 0.378 |
| Tatoeba-test.eng-iba.eng.iba 	| 16.0 	| 0.437 |
| Tatoeba-test.eng-ibo.eng.ibo 	| 2.9 	| 0.221 |
| Tatoeba-test.eng-ido.eng.ido 	| 11.5 	| 0.403 |
| Tatoeba-test.eng-iku.eng.iku 	| 2.3 	| 0.089 |
| Tatoeba-test.eng-ile.eng.ile 	| 4.3 	| 0.282 |
| Tatoeba-test.eng-ilo.eng.ilo 	| 26.4 	| 0.522 |
| Tatoeba-test.eng-ina.eng.ina 	| 20.9 	| 0.493 |
| Tatoeba-test.eng-isl.eng.isl 	| 12.5 	| 0.375 |
| Tatoeba-test.eng-ita.eng.ita 	| 33.9 	| 0.592 |
| Tatoeba-test.eng-izh.eng.izh 	| 4.6 	| 0.050 |
| Tatoeba-test.eng-jav.eng.jav 	| 7.8 	| 0.328 |
| Tatoeba-test.eng-jbo.eng.jbo 	| 0.1 	| 0.123 |
| Tatoeba-test.eng-jdt.eng.jdt 	| 6.4 	| 0.008 |
| Tatoeba-test.eng-jpn.eng.jpn 	| 0.0 	| 0.000 |
| Tatoeba-test.eng-kab.eng.kab 	| 5.9 	| 0.261 |
| Tatoeba-test.eng-kal.eng.kal 	| 13.4 	| 0.382 |
| Tatoeba-test.eng-kan.eng.kan 	| 4.8 	| 0.358 |
| Tatoeba-test.eng-kat.eng.kat 	| 1.8 	| 0.115 |
| Tatoeba-test.eng-kaz.eng.kaz 	| 8.8 	| 0.354 |
| Tatoeba-test.eng-kek.eng.kek 	| 3.7 	| 0.188 |
| Tatoeba-test.eng-kha.eng.kha 	| 0.5 	| 0.094 |
| Tatoeba-test.eng-khm.eng.khm 	| 0.4 	| 0.243 |
| Tatoeba-test.eng-kin.eng.kin 	| 5.2 	| 0.362 |
| Tatoeba-test.eng-kir.eng.kir 	| 17.2 	| 0.416 |
| Tatoeba-test.eng-kjh.eng.kjh 	| 0.6 	| 0.009 |
| Tatoeba-test.eng-kok.eng.kok 	| 5.5 	| 0.005 |
| Tatoeba-test.eng-kom.eng.kom 	| 2.4 	| 0.012 |
| Tatoeba-test.eng-krl.eng.krl 	| 2.0 	| 0.099 |
| Tatoeba-test.eng-ksh.eng.ksh 	| 0.4 	| 0.074 |
| Tatoeba-test.eng-kum.eng.kum 	| 0.9 	| 0.007 |
| Tatoeba-test.eng-kur.eng.kur 	| 9.1 	| 0.174 |
| Tatoeba-test.eng-lad.eng.lad 	| 1.2 	| 0.154 |
| Tatoeba-test.eng-lah.eng.lah 	| 0.1 	| 0.001 |
| Tatoeba-test.eng-lao.eng.lao 	| 0.6 	| 0.426 |
| Tatoeba-test.eng-lat.eng.lat 	| 8.2 	| 0.366 |
| Tatoeba-test.eng-lav.eng.lav 	| 20.4 	| 0.475 |
| Tatoeba-test.eng-ldn.eng.ldn 	| 0.3 	| 0.059 |
| Tatoeba-test.eng-lfn.eng.lfn 	| 0.5 	| 0.104 |
| Tatoeba-test.eng-lij.eng.lij 	| 0.2 	| 0.094 |
| Tatoeba-test.eng-lin.eng.lin 	| 1.2 	| 0.276 |
| Tatoeba-test.eng-lit.eng.lit 	| 17.4 	| 0.488 |
| Tatoeba-test.eng-liv.eng.liv 	| 0.3 	| 0.039 |
| Tatoeba-test.eng-lkt.eng.lkt 	| 0.3 	| 0.041 |
| Tatoeba-test.eng-lld.eng.lld 	| 0.1 	| 0.083 |
| Tatoeba-test.eng-lmo.eng.lmo 	| 1.4 	| 0.154 |
| Tatoeba-test.eng-ltz.eng.ltz 	| 19.1 	| 0.395 |
| Tatoeba-test.eng-lug.eng.lug 	| 4.2 	| 0.382 |
| Tatoeba-test.eng-mad.eng.mad 	| 2.1 	| 0.075 |
| Tatoeba-test.eng-mah.eng.mah 	| 9.5 	| 0.331 |
| Tatoeba-test.eng-mai.eng.mai 	| 9.3 	| 0.372 |
| Tatoeba-test.eng-mal.eng.mal 	| 8.3 	| 0.437 |
| Tatoeba-test.eng-mar.eng.mar 	| 13.5 	| 0.410 |
| Tatoeba-test.eng-mdf.eng.mdf 	| 2.3 	| 0.008 |
| Tatoeba-test.eng-mfe.eng.mfe 	| 83.6 	| 0.905 |
| Tatoeba-test.eng-mic.eng.mic 	| 7.6 	| 0.214 |
| Tatoeba-test.eng-mkd.eng.mkd 	| 31.8 	| 0.540 |
| Tatoeba-test.eng-mlg.eng.mlg 	| 31.3 	| 0.464 |
| Tatoeba-test.eng-mlt.eng.mlt 	| 11.7 	| 0.427 |
| Tatoeba-test.eng-mnw.eng.mnw 	| 0.1 	| 0.000 |
| Tatoeba-test.eng-moh.eng.moh 	| 0.6 	| 0.067 |
| Tatoeba-test.eng-mon.eng.mon 	| 8.5 	| 0.323 |
| Tatoeba-test.eng-mri.eng.mri 	| 8.5 	| 0.320 |
| Tatoeba-test.eng-msa.eng.msa 	| 24.5 	| 0.498 |
| Tatoeba-test.eng.multi 	| 22.4 	| 0.451 |
| Tatoeba-test.eng-mwl.eng.mwl 	| 3.8 	| 0.169 |
| Tatoeba-test.eng-mya.eng.mya 	| 0.2 	| 0.123 |
| Tatoeba-test.eng-myv.eng.myv 	| 1.1 	| 0.014 |
| Tatoeba-test.eng-nau.eng.nau 	| 0.6 	| 0.109 |
| Tatoeba-test.eng-nav.eng.nav 	| 1.8 	| 0.149 |
| Tatoeba-test.eng-nds.eng.nds 	| 11.3 	| 0.365 |
| Tatoeba-test.eng-nep.eng.nep 	| 0.5 	| 0.004 |
| Tatoeba-test.eng-niu.eng.niu 	| 34.4 	| 0.501 |
| Tatoeba-test.eng-nld.eng.nld 	| 37.6 	| 0.598 |
| Tatoeba-test.eng-nog.eng.nog 	| 0.2 	| 0.010 |
| Tatoeba-test.eng-non.eng.non 	| 0.2 	| 0.096 |
| Tatoeba-test.eng-nor.eng.nor 	| 36.3 	| 0.577 |
| Tatoeba-test.eng-nov.eng.nov 	| 0.9 	| 0.180 |
| Tatoeba-test.eng-nya.eng.nya 	| 9.8 	| 0.524 |
| Tatoeba-test.eng-oci.eng.oci 	| 6.3 	| 0.288 |
| Tatoeba-test.eng-ori.eng.ori 	| 5.3 	| 0.273 |
| Tatoeba-test.eng-orv.eng.orv 	| 0.2 	| 0.007 |
| Tatoeba-test.eng-oss.eng.oss 	| 3.0 	| 0.230 |
| Tatoeba-test.eng-ota.eng.ota 	| 0.2 	| 0.053 |
| Tatoeba-test.eng-pag.eng.pag 	| 20.2 	| 0.513 |
| Tatoeba-test.eng-pan.eng.pan 	| 6.4 	| 0.301 |
| Tatoeba-test.eng-pap.eng.pap 	| 44.7 	| 0.624 |
| Tatoeba-test.eng-pau.eng.pau 	| 0.8 	| 0.098 |
| Tatoeba-test.eng-pdc.eng.pdc 	| 2.9 	| 0.143 |
| Tatoeba-test.eng-pms.eng.pms 	| 0.6 	| 0.124 |
| Tatoeba-test.eng-pol.eng.pol 	| 22.7 	| 0.500 |
| Tatoeba-test.eng-por.eng.por 	| 31.6 	| 0.570 |
| Tatoeba-test.eng-ppl.eng.ppl 	| 0.5 	| 0.085 |
| Tatoeba-test.eng-prg.eng.prg 	| 0.1 	| 0.078 |
| Tatoeba-test.eng-pus.eng.pus 	| 0.9 	| 0.137 |
| Tatoeba-test.eng-quc.eng.quc 	| 2.7 	| 0.255 |
| Tatoeba-test.eng-qya.eng.qya 	| 0.4 	| 0.084 |
| Tatoeba-test.eng-rap.eng.rap 	| 1.9 	| 0.050 |
| Tatoeba-test.eng-rif.eng.rif 	| 1.3 	| 0.102 |
| Tatoeba-test.eng-roh.eng.roh 	| 1.4 	| 0.169 |
| Tatoeba-test.eng-rom.eng.rom 	| 7.8 	| 0.329 |
| Tatoeba-test.eng-ron.eng.ron 	| 27.0 	| 0.530 |
| Tatoeba-test.eng-rue.eng.rue 	| 0.1 	| 0.009 |
| Tatoeba-test.eng-run.eng.run 	| 9.8 	| 0.434 |
| Tatoeba-test.eng-rus.eng.rus 	| 22.2 	| 0.465 |
| Tatoeba-test.eng-sag.eng.sag 	| 4.8 	| 0.155 |
| Tatoeba-test.eng-sah.eng.sah 	| 0.2 	| 0.007 |
| Tatoeba-test.eng-san.eng.san 	| 1.7 	| 0.143 |
| Tatoeba-test.eng-scn.eng.scn 	| 1.5 	| 0.083 |
| Tatoeba-test.eng-sco.eng.sco 	| 30.3 	| 0.514 |
| Tatoeba-test.eng-sgs.eng.sgs 	| 1.6 	| 0.104 |
| Tatoeba-test.eng-shs.eng.shs 	| 0.7 	| 0.049 |
| Tatoeba-test.eng-shy.eng.shy 	| 0.6 	| 0.064 |
| Tatoeba-test.eng-sin.eng.sin 	| 5.4 	| 0.317 |
| Tatoeba-test.eng-sjn.eng.sjn 	| 0.3 	| 0.074 |
| Tatoeba-test.eng-slv.eng.slv 	| 12.8 	| 0.313 |
| Tatoeba-test.eng-sma.eng.sma 	| 0.8 	| 0.063 |
| Tatoeba-test.eng-sme.eng.sme 	| 13.2 	| 0.290 |
| Tatoeba-test.eng-smo.eng.smo 	| 12.1 	| 0.416 |
| Tatoeba-test.eng-sna.eng.sna 	| 27.1 	| 0.533 |
| Tatoeba-test.eng-snd.eng.snd 	| 6.0 	| 0.359 |
| Tatoeba-test.eng-som.eng.som 	| 16.0 	| 0.274 |
| Tatoeba-test.eng-spa.eng.spa 	| 36.7 	| 0.603 |
| Tatoeba-test.eng-sqi.eng.sqi 	| 32.3 	| 0.573 |
| Tatoeba-test.eng-stq.eng.stq 	| 0.6 	| 0.198 |
| Tatoeba-test.eng-sun.eng.sun 	| 39.0 	| 0.447 |
| Tatoeba-test.eng-swa.eng.swa 	| 1.1 	| 0.109 |
| Tatoeba-test.eng-swe.eng.swe 	| 42.7 	| 0.614 |
| Tatoeba-test.eng-swg.eng.swg 	| 0.6 	| 0.118 |
| Tatoeba-test.eng-tah.eng.tah 	| 12.4 	| 0.294 |
| Tatoeba-test.eng-tam.eng.tam 	| 5.0 	| 0.404 |
| Tatoeba-test.eng-tat.eng.tat 	| 9.9 	| 0.326 |
| Tatoeba-test.eng-tel.eng.tel 	| 4.7 	| 0.326 |
| Tatoeba-test.eng-tet.eng.tet 	| 0.7 	| 0.100 |
| Tatoeba-test.eng-tgk.eng.tgk 	| 5.5 	| 0.304 |
| Tatoeba-test.eng-tha.eng.tha 	| 2.2 	| 0.456 |
| Tatoeba-test.eng-tir.eng.tir 	| 1.5 	| 0.197 |
| Tatoeba-test.eng-tlh.eng.tlh 	| 0.0 	| 0.032 |
| Tatoeba-test.eng-tly.eng.tly 	| 0.3 	| 0.061 |
| Tatoeba-test.eng-toi.eng.toi 	| 8.3 	| 0.219 |
| Tatoeba-test.eng-ton.eng.ton 	| 32.7 	| 0.619 |
| Tatoeba-test.eng-tpw.eng.tpw 	| 1.4 	| 0.136 |
| Tatoeba-test.eng-tso.eng.tso 	| 9.6 	| 0.465 |
| Tatoeba-test.eng-tuk.eng.tuk 	| 9.4 	| 0.383 |
| Tatoeba-test.eng-tur.eng.tur 	| 24.1 	| 0.542 |
| Tatoeba-test.eng-tvl.eng.tvl 	| 8.9 	| 0.398 |
| Tatoeba-test.eng-tyv.eng.tyv 	| 10.4 	| 0.249 |
| Tatoeba-test.eng-tzl.eng.tzl 	| 0.2 	| 0.098 |
| Tatoeba-test.eng-udm.eng.udm 	| 6.5 	| 0.212 |
| Tatoeba-test.eng-uig.eng.uig 	| 2.1 	| 0.266 |
| Tatoeba-test.eng-ukr.eng.ukr 	| 24.3 	| 0.479 |
| Tatoeba-test.eng-umb.eng.umb 	| 4.4 	| 0.274 |
| Tatoeba-test.eng-urd.eng.urd 	| 8.6 	| 0.344 |
| Tatoeba-test.eng-uzb.eng.uzb 	| 6.9 	| 0.343 |
| Tatoeba-test.eng-vec.eng.vec 	| 1.0 	| 0.094 |
| Tatoeba-test.eng-vie.eng.vie 	| 23.2 	| 0.420 |
| Tatoeba-test.eng-vol.eng.vol 	| 0.3 	| 0.086 |
| Tatoeba-test.eng-war.eng.war 	| 11.4 	| 0.415 |
| Tatoeba-test.eng-wln.eng.wln 	| 8.4 	| 0.218 |
| Tatoeba-test.eng-wol.eng.wol 	| 11.5 	| 0.252 |
| Tatoeba-test.eng-xal.eng.xal 	| 0.1 	| 0.007 |
| Tatoeba-test.eng-xho.eng.xho 	| 19.5 	| 0.552 |
| Tatoeba-test.eng-yid.eng.yid 	| 4.0 	| 0.256 |
| Tatoeba-test.eng-yor.eng.yor 	| 8.8 	| 0.247 |
| Tatoeba-test.eng-zho.eng.zho 	| 21.8 	| 0.192 |
| Tatoeba-test.eng-zul.eng.zul 	| 34.3 	| 0.655 |
| Tatoeba-test.eng-zza.eng.zza 	| 0.5 	| 0.080 |


### System Info: 
- hf_name: eng-mul

- source_languages: eng

- target_languages: mul

- opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/eng-mul/README.md

- original_repo: Tatoeba-Challenge

- tags: ['translation']

- languages: ['en', 'ca', 'es', 'os', 'eo', 'ro', 'fy', 'cy', 'is', 'lb', 'su', 'an', 'sq', 'fr', 'ht', 'rm', 'cv', 'ig', 'am', 'eu', 'tr', 'ps', 'af', 'ny', 'ch', 'uk', 'sl', 'lt', 'tk', 'sg', 'ar', 'lg', 'bg', 'be', 'ka', 'gd', 'ja', 'si', 'br', 'mh', 'km', 'th', 'ty', 'rw', 'te', 'mk', 'or', 'wo', 'kl', 'mr', 'ru', 'yo', 'hu', 'fo', 'zh', 'ti', 'co', 'ee', 'oc', 'sn', 'mt', 'ts', 'pl', 'gl', 'nb', 'bn', 'tt', 'bo', 'lo', 'id', 'gn', 'nv', 'hy', 'kn', 'to', 'io', 'so', 'vi', 'da', 'fj', 'gv', 'sm', 'nl', 'mi', 'pt', 'hi', 'se', 'as', 'ta', 'et', 'kw', 'ga', 'sv', 'ln', 'na', 'mn', 'gu', 'wa', 'lv', 'jv', 'el', 'my', 'ba', 'it', 'hr', 'ur', 'ce', 'nn', 'fi', 'mg', 'rn', 'xh', 'ab', 'de', 'cs', 'he', 'zu', 'yi', 'ml', 'mul']

- src_constituents: {'eng'}

- tgt_constituents: {'sjn_Latn', 'cat', 'nan', 'spa', 'ile_Latn', 'pap', 'mwl', 'uzb_Latn', 'mww', 'hil', 'lij', 'avk_Latn', 'lad_Latn', 'lat_Latn', 'bos_Latn', 'oss', 'epo', 'ron', 'fry', 'cym', 'toi_Latn', 'awa', 'swg', 'zsm_Latn', 'zho_Hant', 'gcf_Latn', 'uzb_Cyrl', 'isl', 'lfn_Latn', 'shs_Latn', 'nov_Latn', 'bho', 'ltz', 'lzh', 'kur_Latn', 'sun', 'arg', 'pes_Thaa', 'sqi', 'uig_Arab', 'csb_Latn', 'fra', 'hat', 'liv_Latn', 'non_Latn', 'sco', 'cmn_Hans', 'pnb', 'roh', 'chv', 'ibo', 'bul_Latn', 'amh', 'lfn_Cyrl', 'eus', 'fkv_Latn', 'tur', 'pus', 'afr', 'brx_Latn', 'nya', 'acm', 'ota_Latn', 'cha', 'ukr', 'xal', 'slv', 'lit', 'zho_Hans', 'tmw_Latn', 'kjh', 'ota_Arab', 'war', 'tuk', 'sag', 'myv', 'hsb', 'lzh_Hans', 'ara', 'tly_Latn', 'lug', 'brx', 'bul', 'bel', 'vol_Latn', 'kat', 'gan', 'got_Goth', 'vro', 'ext', 'afh_Latn', 'gla', 'jpn', 'udm', 'mai', 'ary', 'sin', 'tvl', 'hif_Latn', 'cjy_Hant', 'bre', 'ceb', 'mah', 'nob_Hebr', 'crh_Latn', 'prg_Latn', 'khm', 'ang_Latn', 'tha', 'tah', 'tzl', 'aln', 'kin', 'tel', 'ady', 'mkd', 'ori', 'wol', 'aze_Latn', 'jbo', 'niu', 'kal', 'mar', 'vie_Hani', 'arz', 'yue', 'kha', 'san_Deva', 'jbo_Latn', 'gos', 'hau_Latn', 'rus', 'quc', 'cmn', 'yor', 'hun', 'uig_Cyrl', 'fao', 'mnw', 'zho', 'orv_Cyrl', 'iba', 'bel_Latn', 'tir', 'afb', 'crh', 'mic', 'cos', 'swh', 'sah', 'krl', 'ewe', 'apc', 'zza', 'chr', 'grc_Grek', 'tpw_Latn', 'oci', 'mfe', 'sna', 'kir_Cyrl', 'tat_Latn', 'gom', 'ido_Latn', 'sgs', 'pau', 'tgk_Cyrl', 'nog', 'mlt', 'pdc', 'tso', 'srp_Cyrl', 'pol', 'ast', 'glg', 'pms', 'fuc', 'nob', 'qya', 'ben', 'tat', 'kab', 'min', 'srp_Latn', 'wuu', 'dtp', 'jbo_Cyrl', 'tet', 'bod', 'yue_Hans', 'zlm_Latn', 'lao', 'ind', 'grn', 'nav', 'kaz_Cyrl', 'rom', 'hye', 'kan', 'ton', 'ido', 'mhr', 'scn', 'som', 'rif_Latn', 'vie', 'enm_Latn', 'lmo', 'npi', 'pes', 'dan', 'fij', 'ina_Latn', 'cjy_Hans', 'jdt_Cyrl', 'gsw', 'glv', 'khm_Latn', 'smo', 'umb', 'sma', 'gil', 'nld', 'snd_Arab', 'arq', 'mri', 'kur_Arab', 'por', 'hin', 'shy_Latn', 'sme', 'rap', 'tyv', 'dsb', 'moh', 'asm', 'lad', 'yue_Hant', 'kpv', 'tam', 'est', 'frm_Latn', 'hoc_Latn', 'bam_Latn', 'kek_Latn', 'ksh', 'tlh_Latn', 'ltg', 'pan_Guru', 'hnj_Latn', 'cor', 'gle', 'swe', 'lin', 'qya_Latn', 'kum', 'mad', 'cmn_Hant', 'fuv', 'nau', 'mon', 'akl_Latn', 'guj', 'kaz_Latn', 'wln', 'tuk_Latn', 'jav_Java', 'lav', 'jav', 'ell', 'frr', 'mya', 'bak', 'rue', 'ita', 'hrv', 'izh', 'ilo', 'dws_Latn', 'urd', 'stq', 'tat_Arab', 'haw', 'che', 'pag', 'nno', 'fin', 'mlg', 'ppl_Latn', 'run', 'xho', 'abk', 'deu', 'hoc', 'lkt', 'lld_Latn', 'tzl_Latn', 'mdf', 'ike_Latn', 'ces', 'ldn_Latn', 'egl', 'heb', 'vec', 'zul', 'max_Latn', 'pes_Latn', 'yid', 'mal', 'nds'}

- src_multilingual: False

- tgt_multilingual: True

- prepro:  normalization + SentencePiece (spm32k,spm32k)

- url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/eng-mul/opus2m-2020-08-01.zip

- url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/eng-mul/opus2m-2020-08-01.test.txt

- src_alpha3: eng

- tgt_alpha3: mul

- short_pair: en-mul

- chrF2_score: 0.451

- bleu: 22.4

- brevity_penalty: 0.987

- ref_len: 68724.0

- src_name: English

- tgt_name: Multiple languages

- train_date: 2020-08-01

- src_alpha2: en

- tgt_alpha2: mul

- prefer_old: False

- long_pair: eng-mul

- helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

- transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

- port_machine: brutasse

- port_time: 2020-08-21-14:41