readme: ---
  tags:
  - generated_from_keras_callback
  model-index:
  - name: t5-tiny-finetuned-noisy-ms-en
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information Keras had access to. You should
  probably proofread and complete it, then remove this comment. -->
  
  # t5-super-tiny-finetuned-noisy-ms-en
  
  This model was finetuned from https://github.com/huseinzol05/malaya/tree/master/pretrained-model/t5, t5-super-tiny-social-media-2021-11-15.tar.gz, on https://huggingface.co/datasets/mesolitica/ms-en and https://huggingface.co/datasets/mesolitica/noisy-ms-en-augmentation
  
  ## Evaluation
  
  ### evaluation set
  
  It achieves the following results on the evaluation set using SacreBLEU from [t5-super-tiny-noisy-ms-en-huggingface.ipynb](t5-super-tiny-noisy-ms-en-huggingface.ipynb):
  
  ```
  {'name': 'BLEU',
   'score': 59.92897086989418,
   '_mean': -1.0,
   '_ci': -1.0,
   '_verbose': '79.8/64.0/54.1/46.6 (BP = 1.000 ratio = 1.008 hyp_len = 2017101 ref_len = 2001100)',
   'bp': 1.0,
   'counts': [1609890, 1235532, 997094, 818350],
   'totals': [2017101, 1929506, 1842087, 1755069],
   'sys_len': 2017101,
   'ref_len': 2001100,
   'precisions': [79.81206692178527,
    64.03359201785328,
    54.12849664538103,
    46.62779640002758],
   'prec_str': '79.8/64.0/54.1/46.6',
   'ratio': 1.0079961021438208}
  ```
  
  **The test set is from a semisupervised model, this model might generate better results than the semisupervised model**.
  
  ### FLORES200
  
  It achieved the following results on the [NLLB 200 test set](https://github.com/facebookresearch/flores/tree/main/flores200) using SacreBLEU from [sacrebleu-mesolitica-t5-super-tiny-finetuned-noisy-ms-en-flores200.ipynb](sacrebleu-mesolitica-t5-super-tiny-finetuned-noisy-ms-en-flores200.ipynb),
  
  ```
  chrF2++ = 59.12
  ```
  
  ### Framework versions
  
  - Transformers 4.19.0
  - TensorFlow 2.6.0
  - Datasets 2.1.0
  - Tokenizers 0.12.1