readme: ---
  language: 
  - nl
  - en
  - lb
  - af
  - de
  - fy
  - yi
  - gmw
  
  tags:
  - translation
  
  license: apache-2.0
  ---
  
  ### gmw-gmw
  
  * source group: West Germanic languages 
  * target group: West Germanic languages 
  *  OPUS readme: [gmw-gmw](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/gmw-gmw/README.md)
  
  *  model: transformer
  * source language(s): afr ang_Latn deu eng enm_Latn frr fry gos gsw ksh ltz nds nld pdc sco stq swg yid
  * target language(s): afr ang_Latn deu eng enm_Latn frr fry gos gsw ksh ltz nds nld pdc sco stq swg yid
  * model: transformer
  * pre-processing: normalization + SentencePiece (spm32k,spm32k)
  * a sentence initial language token is required in the form of `>>id<<` (id = valid target language ID)
  * download original weights: [opus-2020-07-27.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/gmw-gmw/opus-2020-07-27.zip)
  * test set translations: [opus-2020-07-27.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/gmw-gmw/opus-2020-07-27.test.txt)
  * test set scores: [opus-2020-07-27.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/gmw-gmw/opus-2020-07-27.eval.txt)
  
  ## Benchmarks
  
  | testset               | BLEU  | chr-F |
  |-----------------------|-------|-------|
  | newssyscomb2009-deueng.deu.eng 	| 25.3 	| 0.527 |
  | newssyscomb2009-engdeu.eng.deu 	| 19.0 	| 0.502 |
  | news-test2008-deueng.deu.eng 	| 23.7 	| 0.515 |
  | news-test2008-engdeu.eng.deu 	| 19.2 	| 0.491 |
  | newstest2009-deueng.deu.eng 	| 23.1 	| 0.514 |
  | newstest2009-engdeu.eng.deu 	| 18.6 	| 0.495 |
  | newstest2010-deueng.deu.eng 	| 25.8 	| 0.545 |
  | newstest2010-engdeu.eng.deu 	| 20.3 	| 0.505 |
  | newstest2011-deueng.deu.eng 	| 23.7 	| 0.523 |
  | newstest2011-engdeu.eng.deu 	| 18.9 	| 0.490 |
  | newstest2012-deueng.deu.eng 	| 24.4 	| 0.529 |
  | newstest2012-engdeu.eng.deu 	| 19.2 	| 0.489 |
  | newstest2013-deueng.deu.eng 	| 27.2 	| 0.545 |
  | newstest2013-engdeu.eng.deu 	| 22.4 	| 0.514 |
  | newstest2014-deen-deueng.deu.eng 	| 27.0 	| 0.546 |
  | newstest2015-ende-deueng.deu.eng 	| 28.4 	| 0.552 |
  | newstest2015-ende-engdeu.eng.deu 	| 25.3 	| 0.541 |
  | newstest2016-ende-deueng.deu.eng 	| 33.2 	| 0.595 |
  | newstest2016-ende-engdeu.eng.deu 	| 29.8 	| 0.578 |
  | newstest2017-ende-deueng.deu.eng 	| 29.0 	| 0.557 |
  | newstest2017-ende-engdeu.eng.deu 	| 23.9 	| 0.534 |
  | newstest2018-ende-deueng.deu.eng 	| 35.9 	| 0.607 |
  | newstest2018-ende-engdeu.eng.deu 	| 34.8 	| 0.609 |
  | newstest2019-deen-deueng.deu.eng 	| 32.1 	| 0.579 |
  | newstest2019-ende-engdeu.eng.deu 	| 31.0 	| 0.579 |
  | Tatoeba-test.afr-ang.afr.ang 	| 0.0 	| 0.065 |
  | Tatoeba-test.afr-deu.afr.deu 	| 46.8 	| 0.668 |
  | Tatoeba-test.afr-eng.afr.eng 	| 58.5 	| 0.728 |
  | Tatoeba-test.afr-enm.afr.enm 	| 13.4 	| 0.357 |
  | Tatoeba-test.afr-fry.afr.fry 	| 5.3 	| 0.026 |
  | Tatoeba-test.afr-gos.afr.gos 	| 3.5 	| 0.228 |
  | Tatoeba-test.afr-ltz.afr.ltz 	| 1.6 	| 0.131 |
  | Tatoeba-test.afr-nld.afr.nld 	| 55.4 	| 0.715 |
  | Tatoeba-test.afr-yid.afr.yid 	| 3.4 	| 0.008 |
  | Tatoeba-test.ang-afr.ang.afr 	| 3.1 	| 0.096 |
  | Tatoeba-test.ang-deu.ang.deu 	| 2.6 	| 0.188 |
  | Tatoeba-test.ang-eng.ang.eng 	| 5.4 	| 0.211 |
  | Tatoeba-test.ang-enm.ang.enm 	| 1.7 	| 0.197 |
  | Tatoeba-test.ang-gos.ang.gos 	| 6.6 	| 0.186 |
  | Tatoeba-test.ang-ltz.ang.ltz 	| 5.3 	| 0.072 |
  | Tatoeba-test.ang-yid.ang.yid 	| 0.9 	| 0.131 |
  | Tatoeba-test.deu-afr.deu.afr 	| 52.7 	| 0.699 |
  | Tatoeba-test.deu-ang.deu.ang 	| 0.8 	| 0.133 |
  | Tatoeba-test.deu-eng.deu.eng 	| 43.5 	| 0.621 |
  | Tatoeba-test.deu-enm.deu.enm 	| 6.9 	| 0.245 |
  | Tatoeba-test.deu-frr.deu.frr 	| 0.8 	| 0.200 |
  | Tatoeba-test.deu-fry.deu.fry 	| 15.1 	| 0.367 |
  | Tatoeba-test.deu-gos.deu.gos 	| 2.2 	| 0.279 |
  | Tatoeba-test.deu-gsw.deu.gsw 	| 1.0 	| 0.176 |
  | Tatoeba-test.deu-ksh.deu.ksh 	| 0.6 	| 0.208 |
  | Tatoeba-test.deu-ltz.deu.ltz 	| 12.1 	| 0.274 |
  | Tatoeba-test.deu-nds.deu.nds 	| 18.8 	| 0.446 |
  | Tatoeba-test.deu-nld.deu.nld 	| 48.6 	| 0.669 |
  | Tatoeba-test.deu-pdc.deu.pdc 	| 4.6 	| 0.198 |
  | Tatoeba-test.deu-sco.deu.sco 	| 12.0 	| 0.340 |
  | Tatoeba-test.deu-stq.deu.stq 	| 3.2 	| 0.240 |
  | Tatoeba-test.deu-swg.deu.swg 	| 0.5 	| 0.179 |
  | Tatoeba-test.deu-yid.deu.yid 	| 1.7 	| 0.160 |
  | Tatoeba-test.eng-afr.eng.afr 	| 55.8 	| 0.730 |
  | Tatoeba-test.eng-ang.eng.ang 	| 5.7 	| 0.157 |
  | Tatoeba-test.eng-deu.eng.deu 	| 36.7 	| 0.584 |
  | Tatoeba-test.eng-enm.eng.enm 	| 2.0 	| 0.272 |
  | Tatoeba-test.eng-frr.eng.frr 	| 6.1 	| 0.246 |
  | Tatoeba-test.eng-fry.eng.fry 	| 15.3 	| 0.378 |
  | Tatoeba-test.eng-gos.eng.gos 	| 1.2 	| 0.242 |
  | Tatoeba-test.eng-gsw.eng.gsw 	| 0.9 	| 0.164 |
  | Tatoeba-test.eng-ksh.eng.ksh 	| 0.9 	| 0.170 |
  | Tatoeba-test.eng-ltz.eng.ltz 	| 13.7 	| 0.263 |
  | Tatoeba-test.eng-nds.eng.nds 	| 17.1 	| 0.410 |
  | Tatoeba-test.eng-nld.eng.nld 	| 49.6 	| 0.673 |
  | Tatoeba-test.eng-pdc.eng.pdc 	| 5.1 	| 0.218 |
  | Tatoeba-test.eng-sco.eng.sco 	| 34.8 	| 0.587 |
  | Tatoeba-test.eng-stq.eng.stq 	| 2.1 	| 0.322 |
  | Tatoeba-test.eng-swg.eng.swg 	| 1.7 	| 0.192 |
  | Tatoeba-test.eng-yid.eng.yid 	| 1.7 	| 0.173 |
  | Tatoeba-test.enm-afr.enm.a