readme: ---
  tags:
  - generated_from_keras_callback
  model-index:
  - name: t5-tiny-finetuned-noisy-ms-en
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information Keras had access to. You should
  probably proofread and complete it, then remove this comment. -->
  
  # t5-tiny-finetuned-noisy-ms-en
  
  This model was finetuned from https://github.com/huseinzol05/malaya/tree/master/pretrained-model/t5, t5-tiny-social-media-2021-11-15.tar.gz, on https://huggingface.co/datasets/mesolitica/ms-en and https://huggingface.co/datasets/mesolitica/noisy-ms-en-augmentation
  
  ## Evaluation
  
  ### evaluation set
  
  It achieves the following results on the evaluation set using SacreBLEU from [t5-tiny-noisy-ms-en-huggingface.ipynb](t5-tiny-noisy-ms-en-huggingface.ipynb):
  
  ```
  {'name': 'BLEU',
   'score': 65.9069151371865,
   '_mean': -1.0,
   '_ci': -1.0,
   '_verbose': '83.0/69.3/60.7/54.1 (BP = 1.000 ratio = 1.001 hyp_len = 2003273 ref_len = 2001100)',
   'bp': 1.0,
   'counts': [1662910, 1327225, 1108852, 941870],
   'totals': [2003273, 1915678, 1828247, 1741231],
   'sys_len': 2003273,
   'ref_len': 2001100,
   'precisions': [83.00965470008332,
    69.28225933585915,
    60.651104582695886,
    54.09219109928551],
   'prec_str': '83.0/69.3/60.7/54.1',
   'ratio': 1.0010859027534855}
  ```
  
  **The test set is from a semisupervised model, this model might generate better results than the semisupervised model**.
  
  ### FLORES200
  
  It achieved the following results on the [NLLB 200 test set](https://github.com/facebookresearch/flores/tree/main/flores200) using SacreBLEU from [sacrebleu-mesolitica-t5-tiny-finetuned-noisy-ms-en-flores200.ipynb](sacrebleu-mesolitica-t5-tiny-finetuned-noisy-ms-en-flores200.ipynb),
  
  ```
  chrF2++ = 59.91
  ```
  
  ### Framework versions
  
  - Transformers 4.19.0
  - TensorFlow 2.6.0
  - Datasets 2.1.0
  - Tokenizers 0.12.1