readme: ---
  language: 
  - da
  - sv
  - af
  - nn
  - fy
  - fo
  - de
  - nb
  - nl
  - is
  - en
  - lb
  - yi
  - gem
  
  tags:
  - translation
  
  license: apache-2.0
  ---
  
  ### gem-gem
  
  * source group: Germanic languages 
  * target group: Germanic languages 
  *  OPUS readme: [gem-gem](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/gem-gem/README.md)
  
  *  model: transformer
  * source language(s): afr ang_Latn dan deu eng enm_Latn fao frr fry gos got_Goth gsw isl ksh ltz nds nld nno nob nob_Hebr non_Latn pdc sco stq swe swg yid
  * target language(s): afr ang_Latn dan deu eng enm_Latn fao frr fry gos got_Goth gsw isl ksh ltz nds nld nno nob nob_Hebr non_Latn pdc sco stq swe swg yid
  * model: transformer
  * pre-processing: normalization + SentencePiece (spm32k,spm32k)
  * a sentence initial language token is required in the form of `>>id<<` (id = valid target language ID)
  * download original weights: [opus-2020-07-27.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/gem-gem/opus-2020-07-27.zip)
  * test set translations: [opus-2020-07-27.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/gem-gem/opus-2020-07-27.test.txt)
  * test set scores: [opus-2020-07-27.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/gem-gem/opus-2020-07-27.eval.txt)
  
  ## Benchmarks
  
  | testset               | BLEU  | chr-F |
  |-----------------------|-------|-------|
  | newssyscomb2009-deueng.deu.eng 	| 24.5 	| 0.519 |
  | newssyscomb2009-engdeu.eng.deu 	| 18.7 	| 0.495 |
  | news-test2008-deueng.deu.eng 	| 22.8 	| 0.509 |
  | news-test2008-engdeu.eng.deu 	| 18.6 	| 0.485 |
  | newstest2009-deueng.deu.eng 	| 22.2 	| 0.507 |
  | newstest2009-engdeu.eng.deu 	| 18.3 	| 0.491 |
  | newstest2010-deueng.deu.eng 	| 24.8 	| 0.537 |
  | newstest2010-engdeu.eng.deu 	| 19.7 	| 0.499 |
  | newstest2011-deueng.deu.eng 	| 22.9 	| 0.516 |
  | newstest2011-engdeu.eng.deu 	| 18.3 	| 0.485 |
  | newstest2012-deueng.deu.eng 	| 23.9 	| 0.524 |
  | newstest2012-engdeu.eng.deu 	| 18.5 	| 0.484 |
  | newstest2013-deueng.deu.eng 	| 26.3 	| 0.537 |
  | newstest2013-engdeu.eng.deu 	| 21.5 	| 0.506 |
  | newstest2014-deen-deueng.deu.eng 	| 25.7 	| 0.535 |
  | newstest2015-ende-deueng.deu.eng 	| 27.3 	| 0.542 |
  | newstest2015-ende-engdeu.eng.deu 	| 24.2 	| 0.534 |
  | newstest2016-ende-deueng.deu.eng 	| 31.8 	| 0.584 |
  | newstest2016-ende-engdeu.eng.deu 	| 28.4 	| 0.564 |
  | newstest2017-ende-deueng.deu.eng 	| 27.6 	| 0.545 |
  | newstest2017-ende-engdeu.eng.deu 	| 22.8 	| 0.527 |
  | newstest2018-ende-deueng.deu.eng 	| 34.1 	| 0.593 |
  | newstest2018-ende-engdeu.eng.deu 	| 32.7 	| 0.595 |
  | newstest2019-deen-deueng.deu.eng 	| 30.6 	| 0.565 |
  | newstest2019-ende-engdeu.eng.deu 	| 29.5 	| 0.567 |
  | Tatoeba-test.afr-ang.afr.ang 	| 0.0 	| 0.053 |
  | Tatoeba-test.afr-dan.afr.dan 	| 57.8 	| 0.907 |
  | Tatoeba-test.afr-deu.afr.deu 	| 46.4 	| 0.663 |
  | Tatoeba-test.afr-eng.afr.eng 	| 57.4 	| 0.717 |
  | Tatoeba-test.afr-enm.afr.enm 	| 11.3 	| 0.285 |
  | Tatoeba-test.afr-fry.afr.fry 	| 0.0 	| 0.167 |
  | Tatoeba-test.afr-gos.afr.gos 	| 1.5 	| 0.178 |
  | Tatoeba-test.afr-isl.afr.isl 	| 29.0 	| 0.760 |
  | Tatoeba-test.afr-ltz.afr.ltz 	| 11.2 	| 0.246 |
  | Tatoeba-test.afr-nld.afr.nld 	| 53.3 	| 0.708 |
  | Tatoeba-test.afr-nor.afr.nor 	| 66.0 	| 0.752 |
  | Tatoeba-test.afr-swe.afr.swe 	| 88.0 	| 0.955 |
  | Tatoeba-test.afr-yid.afr.yid 	| 59.5 	| 0.443 |
  | Tatoeba-test.ang-afr.ang.afr 	| 10.7 	| 0.043 |
  | Tatoeba-test.ang-dan.ang.dan 	| 6.3 	| 0.190 |
  | Tatoeba-test.ang-deu.ang.deu 	| 1.4 	| 0.212 |
  | Tatoeba-test.ang-eng.ang.eng 	| 8.1 	| 0.247 |
  | Tatoeba-test.ang-enm.ang.enm 	| 1.7 	| 0.196 |
  | Tatoeba-test.ang-fao.ang.fao 	| 10.7 	| 0.105 |
  | Tatoeba-test.ang-gos.ang.gos 	| 10.7 	| 0.128 |
  | Tatoeba-test.ang-isl.ang.isl 	| 16.0 	| 0.135 |
  | Tatoeba-test.ang-ltz.ang.ltz 	| 16.0 	| 0.121 |
  | Tatoeba-test.ang-yid.ang.yid 	| 1.5 	| 0.136 |
  | Tatoeba-test.dan-afr.dan.afr 	| 22.7 	| 0.655 |
  | Tatoeba-test.dan-ang.dan.ang 	| 3.1 	| 0.110 |
  | Tatoeba-test.dan-deu.dan.deu 	| 47.4 	| 0.676 |
  | Tatoeba-test.dan-eng.dan.eng 	| 54.7 	| 0.704 |
  | Tatoeba-test.dan-enm.dan.enm 	| 4.8 	| 0.291 |
  | Tatoeba-test.dan-fao.dan.fao 	| 9.7 	| 0.120 |
  | Tatoeba-test.dan-gos.dan.gos 	| 3.8 	| 0.240 |
  | Tatoeba-test.dan-isl.dan.isl 	| 66.1 	| 0.678 |
  | Tatoeba-test.dan-ltz.dan.ltz 	| 78.3 	| 0.563 |
  | Tatoeba-test.dan-nds.dan.nds 	| 6.2 	| 0.335 |
  | Tatoeba-test.dan-nld.dan.nld 	| 60.0 	| 0.748 |
  | Tatoeba-test.dan-nor.dan.nor 	| 68.1 	| 0.812 |
  | Tatoeba-test.dan-swe.dan.swe 	| 65.0 	| 0.785 |
  | Tatoeba-test.dan-swg.dan.swg 	| 2.6 	| 0.182 |
  | Tatoeba-test.dan-yid.dan.yid 	| 9.3 	| 0.226 |
  | Tatoeba-test.deu-afr.deu.afr 	| 50.3 	| 0.682 |
  | Tatoeba-test.deu-ang.deu.ang 	| 0.5 	| 0.118 |
  | Tatoeba-test.deu-dan.deu.dan 	| 49.6 	| 0.679 |
  | Tatoeba-test.deu-eng.deu.eng 	| 43.4 	| 0.618 |
  | Tatoeba-test.deu-enm.deu.enm 	| 2.2 	| 0.159 |
  | Tatoeba-test.deu-frr.deu.frr 	| 0.4 	| 0.156 |
  | Tatoeba-test.deu-fry.deu.fry 	| 10.7 	| 0.355 |
  | Tatoeba-test.deu-gos.deu.gos 	| 0.7 	| 0.183 |
  | Tatoeba-test.deu-got.deu.got 	| 0.3 	| 0.010 |
  | Tatoeba-test.deu-gsw.deu.gsw 	| 1.1 	| 0.1