readme: ---
  license: apache-2.0
  tags:
  - generated_from_trainer
  metrics:
  - rouge
  model-index:
  - name: t5-small-mse-summarization
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # t5-small-mse-summarization
  
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on an unknown dataset.
  It achieves the following results on the evaluation set:
  - Loss: 1.1108
  - Rouge1: 43.1145
  - Rouge2: 23.2262
  - Rougel: 37.218
  - Rougelsum: 41.0897
  - Bleurt: -0.8051
  - Gen Len: 18.549
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 5e-05
  - train_batch_size: 64
  - eval_batch_size: 256
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 20
  
  ### Training results
  
  | Training Loss | Epoch | Step | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum | Bleurt  | Gen Len |
  |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|:-------:|
  | 1.5207        | 1.0   | 267  | 1.2922          | 38.8738 | 19.1958 | 32.8458 | 36.9993   | -0.9061 | 18.668  |
  | 1.363         | 2.0   | 534  | 1.2340          | 39.8466 | 20.0452 | 33.9101 | 37.7708   | -0.8925 | 18.657  |
  | 1.3062        | 3.0   | 801  | 1.2057          | 40.5536 | 20.8249 | 34.5221 | 38.4648   | -0.8625 | 18.602  |
  | 1.272         | 4.0   | 1068 | 1.1782          | 41.0078 | 21.2186 | 35.0101 | 38.9186   | -0.8595 | 18.602  |
  | 1.2312        | 5.0   | 1335 | 1.1688          | 41.521  | 21.7934 | 35.704  | 39.4718   | -0.842  | 18.486  |
  | 1.2052        | 6.0   | 1602 | 1.1557          | 42.1037 | 22.4291 | 36.3554 | 40.1124   | -0.8432 | 18.533  |
  | 1.1842        | 7.0   | 1869 | 1.1440          | 42.4438 | 22.6456 | 36.5729 | 40.3134   | -0.8288 | 18.553  |
  | 1.1643        | 8.0   | 2136 | 1.1408          | 42.245  | 22.4859 | 36.3637 | 40.2193   | -0.8284 | 18.622  |
  | 1.1495        | 9.0   | 2403 | 1.1320          | 42.5362 | 22.5034 | 36.5092 | 40.4552   | -0.8211 | 18.57   |
  | 1.1368        | 10.0  | 2670 | 1.1301          | 42.5159 | 22.462  | 36.4646 | 40.3968   | -0.819  | 18.538  |
  | 1.1203        | 11.0  | 2937 | 1.1243          | 42.2803 | 22.5963 | 36.3454 | 40.2987   | -0.8242 | 18.522  |
  | 1.1116        | 12.0  | 3204 | 1.1197          | 42.8078 | 22.8409 | 36.7344 | 40.8186   | -0.821  | 18.565  |
  | 1.099         | 13.0  | 3471 | 1.1193          | 42.7423 | 22.9397 | 36.7894 | 40.7298   | -0.8125 | 18.552  |
  | 1.0976        | 14.0  | 3738 | 1.1176          | 42.9002 | 23.2394 | 37.0215 | 40.9211   | -0.8156 | 18.568  |
  | 1.0816        | 15.0  | 4005 | 1.1133          | 43.0007 | 23.3093 | 37.2037 | 40.9719   | -0.8059 | 18.519  |
  | 1.084         | 16.0  | 4272 | 1.1146          | 42.9053 | 23.2391 | 37.0542 | 40.8826   | -0.8104 | 18.533  |
  | 1.0755        | 17.0  | 4539 | 1.1124          | 43.0429 | 23.2773 | 37.1389 | 41.0755   | -0.8086 | 18.544  |
  | 1.0748        | 18.0  | 4806 | 1.1121          | 43.2243 | 23.4179 | 37.2039 | 41.143    | -0.8048 | 18.548  |
  | 1.072         | 19.0  | 5073 | 1.1106          | 43.1776 | 23.3061 | 37.3105 | 41.1392   | -0.8039 | 18.549  |
  | 1.0671        | 20.0  | 5340 | 1.1108          | 43.1145 | 23.2262 | 37.218  | 41.0897   | -0.8051 | 18.549  |
  
  
  ### Framework versions
  
  - Transformers 4.21.2
  - Pytorch 1.12.1+cu113
  - Datasets 2.4.0
  - Tokenizers 0.12.1
  