readme: ---
  language: 
    - ms
  tags:
  - translation
  metrics:
  - sacrebleu
  ---
  
  # finetune-translation-t5-super-tiny-standard-bahasa-cased
  
  Finetuned T5 super tiny on EN-MS and MS-EN translation tasks.
  
  ## Dataset
  
  1. EN-MS dataset, https://huggingface.co/datasets/mesolitica/en-ms
  2. MS-EN dataset, https://huggingface.co/datasets/mesolitica/ms-en
  3. NLLB eng_Latn-zsm_Latn, https://github.com/huseinzol05/malay-dataset/tree/master/translation/laser
  
  ## Finetune details
  
  1. Finetune using single RTX 3090 Ti.
  
  Scripts at https://github.com/huseinzol05/malaya/tree/master/session/translation/hf-t5
  
  ## Supported prefix
  
  1. `terjemah Inggeris ke Melayu: {string}`, for EN-MS translation.
  2. `terjemah Melayu ke Inggeris: {string}`, for MS-EN translation.
  
  ## Evaluation
  
  eng_Latn-zsm_Latn,
  ```
  {'name': 'BLEU',
   'score': 39.18834189893951,
   '_mean': -1.0,
   '_ci': -1.0,
   '_verbose': '72.6/48.3/33.5/23.6 (BP = 0.960 ratio = 0.961 hyp_len = 21172 ref_len = 22027)',
   'bp': 0.9604210226409274,
   'counts': [15376, 9741, 6434, 4284],
   'totals': [21172, 20175, 19178, 18181],
   'sys_len': 21172,
   'ref_len': 22027,
   'precisions': [72.62422066880787,
    48.28252788104089,
    33.54885806653457,
    23.563060337715196],
   'prec_str': '72.6/48.3/33.5/23.6',
   'ratio': 0.9611840014527625}
  chrF2++ = 64.03
  ```
  
  zsm_Latn-eng_Latn,
  ```
  {'name': 'BLEU',
   'score': 34.10561487832948,
   '_mean': -1.0,
   '_ci': -1.0,
   '_verbose': '67.3/41.6/27.8/18.7 (BP = 0.982 ratio = 0.982 hyp_len = 23139 ref_len = 23570)',
   'bp': 0.9815458410942027,
   'counts': [15569, 9216, 5871, 3777],
   'totals': [23139, 22142, 21145, 20148],
   'sys_len': 23139,
   'ref_len': 23570,
   'precisions': [67.28467090194044,
    41.62225634540692,
    27.765429179475053,
    18.746277546158428],
   'prec_str': '67.3/41.6/27.8/18.7',
   'ratio': 0.9817140432753501}
  chrF2++ = 59.18
  ```