readme: ---
  license: apache-2.0
  tags:
  - generated_from_trainer
  datasets:
  - cnn_dailymail
  metrics:
  - rouge
  model-index:
  - name: cnn_dailymail-summarization-t5-small-2022-09-05
    results:
    - task:
        name: Summarization
        type: summarization
      dataset:
        name: cnn_dailymail 3.0.0
        type: cnn_dailymail
        args: 3.0.0
      metrics:
      - name: Rouge1
        type: rouge
        value: 41.4235
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # cnn_dailymail-summarization-t5-small-2022-09-05
  
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the cnn_dailymail 3.0.0 dataset.
  It achieves the following results on the evaluation set:
  - Loss: 1.6455
  - Rouge1: 41.4235
  - Rouge2: 19.0263
  - Rougel: 29.2892
  - Rougelsum: 38.6338
  - Gen Len: 73.7273
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 5e-05
  - train_batch_size: 8
  - eval_batch_size: 8
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 3.0
  
  ### Training results
  
  | Training Loss | Epoch | Step   | Gen Len | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum |
  |:-------------:|:-----:|:------:|:-------:|:---------------:|:-------:|:-------:|:-------:|:---------:|
  | 1.9623        | 0.03  | 1000   | 18.9996 | 1.7500          | 24.1039 | 11.368  | 19.813  | 22.671    |
  | 1.8827        | 0.06  | 2000   | 18.9993 | 1.7382          | 24.1445 | 11.4497 | 19.8683 | 22.7376   |
  | 1.8988        | 0.08  | 3000   | 18.9999 | 1.7310          | 24.329  | 11.5899 | 20.0409 | 22.9104   |
  | 1.8778        | 0.11  | 4000   | 19.0    | 1.7177          | 24.3886 | 11.6472 | 20.1048 | 22.988    |
  | 1.9173        | 0.14  | 5000   | 18.9996 | 1.7140          | 24.3508 | 11.5594 | 20.075  | 22.932    |
  | 1.9009        | 0.17  | 6000   | 18.9995 | 1.7134          | 24.28   | 11.6075 | 20.0581 | 22.8833   |
  | 1.8975        | 0.2   | 7000   | 18.9994 | 1.7081          | 24.3203 | 11.6175 | 20.035  | 22.9167   |
  | 1.8835        | 0.22  | 8000   | 18.9996 | 1.7061          | 24.2729 | 11.6324 | 20.0728 | 22.8747   |
  | 1.8725        | 0.25  | 9000   | 19.0    | 1.6995          | 24.2542 | 11.5763 | 20.0241 | 22.8713   |
  | 1.837         | 0.28  | 10000  | 18.9997 | 1.6998          | 24.3321 | 11.599  | 20.1028 | 22.9562   |
  | 1.8629        | 0.31  | 11000  | 19.0    | 1.6944          | 24.4161 | 11.6208 | 20.1374 | 23.024    |
  | 1.85          | 0.33  | 12000  | 18.9990 | 1.7002          | 24.3514 | 11.6883 | 20.134  | 22.9515   |
  | 1.8506        | 0.36  | 13000  | 18.9987 | 1.6894          | 24.3812 | 11.6592 | 20.1641 | 23.0108   |
  | 1.8869        | 0.39  | 14000  | 18.9995 | 1.6881          | 24.3956 | 11.6817 | 20.1654 | 23.0284   |
  | 1.8327        | 0.42  | 15000  | 18.9993 | 1.6903          | 24.3707 | 11.6446 | 20.1353 | 22.9801   |
  | 1.8204        | 0.45  | 16000  | 18.9993 | 1.6896          | 24.3663 | 11.6963 | 20.1357 | 22.9898   |
  | 1.8764        | 0.47  | 17000  | 18.9978 | 1.6846          | 24.4212 | 11.652  | 20.1455 | 23.0326   |
  | 1.8213        | 0.5   | 18000  | 18.9992 | 1.6817          | 24.452  | 11.7014 | 20.1898 | 23.0668   |
  | 1.8424        | 0.53  | 19000  | 18.9990 | 1.6844          | 24.4206 | 11.7049 | 20.1931 | 23.0358   |
  | 1.8721        | 0.56  | 20000  | 18.9996 | 1.6814          | 24.4483 | 11.6789 | 20.1798 | 23.0508   |
  | 1.87          | 0.59  | 21000  | 18.9996 | 1.6796          | 24.4799 | 11.6789 | 20.1919 | 23.0831   |
  | 1.844         | 0.61  | 22000  | 18.9996 | 1.6770          | 24.4741 | 11.7433 | 20.2031 | 23.0535   |
  | 1.8611        | 0.64  | 23000  | 18.9986 | 1.6785          | 24.4837 | 11.7572 | 20.219  | 23.088    |
  | 1.8201        | 0.67  | 24000  | 18.9993 | 1.6796          | 24.3955 | 11.6978 | 20.173  | 23.0302   |
  | 1.8506        | 0.7   | 25000  | 18.9995 | 1.6770          | 24.4084 | 11.711  | 20.1851 | 23.0266   |
  | 1.846         | 0.72  | 26000  | 18.9990 | 1.6765          | 24.4272 | 11.6779 | 20.1785 | 23.0352   |
  | 1.8431        | 0.75  | 27000  | 18.9998 | 1.6757          | 24.4484 | 11.7154 | 20.2156 | 23.0646   |
  | 1.8208        | 0.78  | 28000  | 18.9993 | 1.6764          | 24.412  | 11.6887 | 20.1752 | 23.0151   |
  | 1.8108        | 0.81  | 29000  | 18.9997 | 1.6733          | 24.4051 | 11.7155 | 20.1773 | 23.0215   |
  | 1.847         | 0.84  | 30000  | 18.9994 | 1.6738          | 24.5531 | 11.7949 | 20.2834 | 23.1588   |
  | 1.8386        | 0.86  | 31000  | 18.9991 | 1.6674          | 24.5155 | 11.7333 | 20.2529 | 23.145    |
  | 1.82          | 0.89  | 32000  | 18.9988 | 1.6693          | 24.4498 | 11.7118 | 20.2183 | 23.0767   |
  | 1.8475        | 0.92  