readme: ---
  language: 
    - ms
  tags:
  - translation
  metrics:
  - sacrebleu
  ---
  
  # finetune-translation-t5-small-standard-bahasa-cased
  
  Finetuned T5 small on EN-MS and MS-EN translation tasks.
  
  ## Dataset
  
  1. EN-MS dataset, https://huggingface.co/datasets/mesolitica/en-ms
  2. MS-EN dataset, https://huggingface.co/datasets/mesolitica/ms-en
  3. NLLB eng_Latn-zsm_Latn, https://github.com/huseinzol05/malay-dataset/tree/master/translation/laser
  
  ## Finetune details
  
  1. Finetune using single RTX 3090 Ti.
  
  Scripts at https://github.com/huseinzol05/malaya/tree/master/session/translation/hf-t5
  
  ## Supported prefix
  
  1. `terjemah Inggeris ke Melayu: {string}`, for EN-MS translation.
  2. `terjemah Melayu ke Inggeris: {string}`, for MS-EN translation.
  
  ## Evaluation
  
  eng_Latn-zsm_Latn,
  ```
  {'name': 'BLEU',
   'score': 43.93729753370648,
   '_mean': -1.0,
   '_ci': -1.0,
   '_verbose': '74.9/52.2/37.9/27.7 (BP = 0.976 ratio = 0.977 hyp_len = 21510 ref_len = 22027)',
   'bp': 0.9762512158466284,
   'counts': [16101, 10712, 7389, 5134],
   'totals': [21510, 20513, 19516, 18519],
   'sys_len': 21510,
   'ref_len': 22027,
   'precisions': [74.85355648535565,
    52.220543070248134,
    37.86124205779873,
    27.722879205140668],
   'prec_str': '74.9/52.2/37.9/27.7',
   'ratio': 0.9765288055568166}
  chrF2++ = 67.43
  ```
  
  zsm_Latn-eng_Latn,
  ```
  {'name': 'BLEU',
   'score': 42.01021763049599,
   '_mean': -1.0,
   '_ci': -1.0,
   '_verbose': '71.7/49.0/35.6/26.1 (BP = 0.989 ratio = 0.989 hyp_len = 23302 ref_len = 23570)',
   'bp': 0.988564726798463,
   'counts': [16700, 10937, 7587, 5294],
   'totals': [23302, 22305, 21308, 20311],
   'sys_len': 23302,
   'ref_len': 23570,
   'precisions': [71.6676680113295,
    49.03384891279982,
    35.60634503472874,
    26.06469400817291],
   'prec_str': '71.7/49.0/35.6/26.1',
   'ratio': 0.9886296139159949}
  chrF2++ = 64.67
  ```