readme: ---
  license: apache-2.0
  tags:
  - generated_from_trainer
  metrics:
  - bleu
  model-index:
  - name: t5-small-finetuned-thai-informal-to-formal
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # t5-small-finetuned-thai-informal-to-formal
  
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the None dataset.
  It achieves the following results on the evaluation set:
  - Loss: 1.3091
  - Bleu: 20.5964
  - Gen Len: 19.9981
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 2e-05
  - train_batch_size: 32
  - eval_batch_size: 32
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 300
  - mixed_precision_training: Native AMP
  
  ### Training results
  
  | Training Loss | Epoch | Step   | Validation Loss | Bleu    | Gen Len |
  |:-------------:|:-----:|:------:|:---------------:|:-------:|:-------:|
  | 2.2862        | 1.0   | 1011   | 2.2028          | 31.6678 | 20.0    |
  | 2.1228        | 2.0   | 2022   | 2.0339          | 32.3643 | 20.0    |
  | 2.0581        | 3.0   | 3033   | 1.9386          | 32.3784 | 20.0    |
  | 1.9714        | 4.0   | 4044   | 1.8899          | 31.9728 | 20.0    |
  | 1.9169        | 5.0   | 5055   | 1.8318          | 32.1064 | 20.0    |
  | 1.8969        | 6.0   | 6066   | 1.8005          | 31.4324 | 20.0    |
  | 1.8486        | 7.0   | 7077   | 1.7813          | 31.7758 | 20.0    |
  | 1.802         | 8.0   | 8088   | 1.7464          | 31.9055 | 20.0    |
  | 1.7654        | 9.0   | 9099   | 1.7352          | 31.9598 | 20.0    |
  | 1.7439        | 10.0  | 10110  | 1.7009          | 32.1696 | 20.0    |
  | 1.7603        | 11.0  | 11121  | 1.6873          | 31.8118 | 20.0    |
  | 1.7288        | 12.0  | 12132  | 1.6678          | 31.5711 | 20.0    |
  | 1.7004        | 13.0  | 13143  | 1.6482          | 31.4575 | 20.0    |
  | 1.6851        | 14.0  | 14154  | 1.6374          | 31.9579 | 20.0    |
  | 1.6497        | 15.0  | 15165  | 1.6290          | 31.4299 | 20.0    |
  | 1.656         | 16.0  | 16176  | 1.6130          | 31.2145 | 20.0    |
  | 1.6423        | 17.0  | 17187  | 1.5931          | 31.365  | 20.0    |
  | 1.6024        | 18.0  | 18198  | 1.5797          | 31.2247 | 20.0    |
  | 1.6064        | 19.0  | 19209  | 1.5736          | 31.1535 | 20.0    |
  | 1.5974        | 20.0  | 20220  | 1.5609          | 31.431  | 20.0    |
  | 1.5961        | 21.0  | 21231  | 1.5578          | 30.9905 | 20.0    |
  | 1.5621        | 22.0  | 22242  | 1.5466          | 30.8979 | 20.0    |
  | 1.5307        | 23.0  | 23253  | 1.5285          | 31.277  | 20.0    |
  | 1.5359        | 24.0  | 24264  | 1.5370          | 31.4321 | 20.0    |
  | 1.5558        | 25.0  | 25275  | 1.5215          | 31.2769 | 20.0    |
  | 1.513         | 26.0  | 26286  | 1.5173          | 30.9782 | 19.9997 |
  | 1.5241        | 27.0  | 27297  | 1.5105          | 30.6717 | 20.0    |
  | 1.5133        | 28.0  | 28308  | 1.4973          | 30.3152 | 20.0    |
  | 1.4713        | 29.0  | 29319  | 1.4927          | 30.276  | 19.9997 |
  | 1.478         | 30.0  | 30330  | 1.4887          | 30.1004 | 19.9989 |
  | 1.4572        | 31.0  | 31341  | 1.4845          | 29.8939 | 19.9983 |
  | 1.4485        | 32.0  | 32352  | 1.4653          | 30.0169 | 19.9986 |
  | 1.4404        | 33.0  | 33363  | 1.4648          | 28.9061 | 19.9989 |
  | 1.4408        | 34.0  | 34374  | 1.4586          | 29.598  | 19.9994 |
  | 1.4296        | 35.0  | 35385  | 1.4585          | 28.9821 | 19.9981 |
  | 1.408         | 36.0  | 36396  | 1.4517          | 29.6025 | 19.9986 |
  | 1.4004        | 37.0  | 37407  | 1.4456          | 27.8564 | 19.9992 |
  | 1.3991        | 38.0  | 38418  | 1.4411          | 28.8947 | 19.9994 |
  | 1.401         | 39.0  | 39429  | 1.4309          | 27.6809 | 19.9994 |
  | 1.391         | 40.0  | 40440  | 1.4278          | 29.1687 | 19.9994 |
  | 1.3709        | 41.0  | 41451  | 1.4217          | 28.2947 | 19.9989 |
  | 1.3726        | 42.0  | 42462  | 1.4247          | 27.2108 | 19.9983 |
  | 1.3702        | 43.0  | 43473  | 1.4144          | 25.9973 | 19.9981 |
  | 1.3636        | 44.0  | 44484  | 1.4163          | 26.0146 | 19.9953 |
  | 1.3673        | 45.0  | 45495  | 1.4118          | 25.8126 | 19.9978 |
  | 1.3539        | 46.0  | 46506  | 1.4076          | 25.5185 | 19.9981 |
  | 1.3434        | 47.0  | 47517  | 1.4023          | 26.2123 | 19.9947 |
  | 1.3428        | 48.0  | 48528  | 1.4008          | 25.8932 | 19.9955 |
  | 1.3325        | 49.0  | 49539  | 1.4003          | 25.7762 | 19.9969 |
  | 1.3258        | 50.0  | 50550  | 1.3896          | 24.8206 | 19.9961 |
  | 1.3151        | 51.0  | 51561  | 1.3852          | 24.4683 | 19.9978 |
  | 1.3035      