readme: ---
  license: apache-2.0
  tags:
  - generated_from_keras_callback
  model-index:
  - name: kapuska/t5-small-finetuned-on-800-records-samsum
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information Keras had access to. You should
  probably proofread and complete it, then remove this comment. -->
  
  # kapuska/t5-small-finetuned-on-800-records-samsum
  
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on an unknown dataset.
  It achieves the following results on the evaluation set:
  - Train Loss: 0.7883
  - Validation Loss: 2.3752
  - Train Rouge1: 24.8093
  - Train Rouge2: 8.8889
  - Train Rougel: 22.6817
  - Train Rougelsum: 22.6817
  - Train Gen Len: 19.0
  - Epoch: 99
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
  - training_precision: float32
  
  ### Training results
  
  | Train Loss | Validation Loss | Train Rouge1 | Train Rouge2 | Train Rougel | Train Rougelsum | Train Gen Len | Epoch |
  |:----------:|:---------------:|:------------:|:------------:|:------------:|:---------------:|:-------------:|:-----:|
  | 1.9252     | 1.9205          | 19.5556      | 2.3256       | 15.1111      | 15.1111         | 19.0          | 0     |
  | 1.9005     | 1.9227          | 17.5579      | 2.3810       | 15.2852      | 15.2852         | 19.0          | 1     |
  | 1.8769     | 1.9228          | 17.5579      | 2.3810       | 15.2852      | 15.2852         | 19.0          | 2     |
  | 1.8463     | 1.9192          | 17.5579      | 2.3810       | 15.2852      | 15.2852         | 19.0          | 3     |
  | 1.8251     | 1.9132          | 17.4786      | 2.3256       | 13.0342      | 13.0342         | 19.0          | 4     |
  | 1.8148     | 1.9147          | 15.5594      | 2.3810       | 13.2867      | 13.2867         | 19.0          | 5     |
  | 1.7980     | 1.9142          | 15.5594      | 2.3810       | 13.2867      | 13.2867         | 19.0          | 6     |
  | 1.7684     | 1.9158          | 15.6772      | 2.3810       | 13.4045      | 13.4045         | 19.0          | 7     |
  | 1.7571     | 1.9161          | 17.5964      | 2.3256       | 13.1519      | 13.1519         | 19.0          | 8     |
  | 1.7345     | 1.9221          | 19.6372      | 2.3256       | 15.1927      | 15.1927         | 19.0          | 9     |
  | 1.7136     | 1.9141          | 19.6372      | 2.3256       | 15.1927      | 15.1927         | 19.0          | 10    |
  | 1.6935     | 1.9249          | 19.6372      | 2.3256       | 15.1927      | 15.1927         | 19.0          | 11    |
  | 1.6685     | 1.9226          | 19.6372      | 2.3256       | 15.1927      | 15.1927         | 19.0          | 12    |
  | 1.6571     | 1.9258          | 19.6372      | 2.3256       | 15.1927      | 15.1927         | 19.0          | 13    |
  | 1.6327     | 1.9308          | 19.6372      | 2.3256       | 15.1927      | 15.1927         | 19.0          | 14    |
  | 1.6295     | 1.9271          | 19.6372      | 2.3256       | 15.1927      | 15.1927         | 19.0          | 15    |
  | 1.6112     | 1.9314          | 19.5556      | 2.3256       | 15.1111      | 15.1111         | 19.0          | 16    |
  | 1.6008     | 1.9357          | 19.6372      | 2.3256       | 15.1927      | 15.1927         | 19.0          | 17    |
  | 1.5826     | 1.9277          | 19.3913      | 2.2727       | 15.0435      | 15.0435         | 19.0          | 18    |
  | 1.5784     | 1.9342          | 21.3913      | 2.2727       | 17.0435      | 17.0435         | 19.0          | 19    |
  | 1.5553     | 1.9364          | 19.3913      | 2.2727       | 15.0435      | 15.0435         | 19.0          | 20    |
  | 1.5292     | 1.9461          | 19.3913      | 2.2727       | 15.0435      | 15.0435         | 19.0          | 21    |
  | 1.5114     | 1.9505          | 19.3913      | 2.2727       | 15.0435      | 15.0435         | 19.0          | 22    |
  | 1.5042     | 1.9540          | 17.5964      | 2.3256       | 13.1519      | 13.1519         | 19.0          | 23    |
  | 1.4964     | 1.9494          | 19.0621      | 4.4444       | 16.9344      | 16.9344         | 19.0          | 24    |
  | 1.4736     | 1.9569          | 24.7136      | 4.4444       | 20.6628      | 22.5859         | 19.0          | 25    |
  | 1.4644     | 1.9618          | 24.7136      | 4.4444       | 20.6628      | 22.5859         | 19.0          | 26    |
  | 1.4562     | 1.9693          | 18.9821      | 4.4444       | 16.8544      | 16.8544         | 19.0          | 27    |
  | 1.4339     | 1.9597          | 22.7905      | 4.4444       | 18.7398      | 20.6628         | 19.0          | 28    |
  | 1.4204     | 1.9702          | 18.9444      | 4.4444