readme: ---
  language: 
    - ms
  tags:
  - translation
  metrics:
  - sacrebleu
  ---
  
  # finetune-translation-t5-base-standard-bahasa-cased
  
  Finetuned T5 base on EN-MS and MS-EN translation tasks.
  
  ## Dataset
  
  1. EN-MS dataset, https://huggingface.co/datasets/mesolitica/en-ms
  2. MS-EN dataset, https://huggingface.co/datasets/mesolitica/ms-en
  3. NLLB eng_Latn-zsm_Latn, https://github.com/huseinzol05/malay-dataset/tree/master/translation/laser
  
  ## Finetune details
  
  1. Finetune using single RTX 3090 Ti.
  
  Scripts at https://github.com/huseinzol05/malaya/tree/master/session/translation/hf-t5
  
  ## Supported prefix
  
  1. `terjemah Inggeris ke Melayu: {string}`, for EN-MS translation.
  2. `terjemah Melayu ke Inggeris: {string}`, for MS-EN translation.
  
  ## Evaluation
  
  eng_Latn-zsm_Latn,
  ```
  {'name': 'BLEU',
   'score': 44.424181019348296,
   '_mean': -1.0,
   '_ci': -1.0,
   '_verbose': '74.7/52.2/38.0/28.1 (BP = 0.983 ratio = 0.983 hyp_len = 21652 ref_len = 22027)',
   'bp': 0.9828297027433637,
   'counts': [16164, 10792, 7476, 5251],
   'totals': [21652, 20655, 19658, 18661],
   'sys_len': 21652,
   'ref_len': 22027,
   'precisions': [74.65361167559578,
    52.24885015734689,
    38.030318445416626,
    28.138899308718717],
   'prec_str': '74.7/52.2/38.0/28.1',
   'ratio': 0.9829754392336678}
  chrF2++ = 67.80
  ```
  
  zsm_Latn-eng_Latn,
  ```
  {'name': 'BLEU',
   'score': 43.18824583942534,
   '_mean': -1.0,
   '_ci': -1.0,
   '_verbose': '72.6/50.5/37.1/27.4 (BP = 0.983 ratio = 0.984 hyp_len = 23184 ref_len = 23570)',
   'bp': 0.9834884220745148,
   'counts': [16824, 11197, 7854, 5532],
   'totals': [23184, 22187, 21190, 20193],
   'sys_len': 23184,
   'ref_len': 23570,
   'precisions': [72.5672877846791,
    50.4664893856763,
    37.06465313827277,
    27.395632149754867],
   'prec_str': '72.6/50.5/37.1/27.4',
   'ratio': 0.983623249893933}
  chrF2++ = 65.52
  ```