readme: ---
  license: apache-2.0
  tags:
  - generated_from_trainer
  model-index:
  - name: t5-small-entailement-Writer-T5-base
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # t5-small-entailement-Writer-T5-base
  
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the None dataset.
  It achieves the following results on the evaluation set:
  - Loss: 0.5697
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 2e-05
  - train_batch_size: 32
  - eval_batch_size: 32
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 250
  - mixed_precision_training: Native AMP
  
  ### Training results
  
  | Training Loss | Epoch | Step  | Validation Loss |
  |:-------------:|:-----:|:-----:|:---------------:|
  | No log        | 1.0   | 42    | 1.8185          |
  | No log        | 2.0   | 84    | 1.1957          |
  | No log        | 3.0   | 126   | 0.9771          |
  | No log        | 4.0   | 168   | 0.8964          |
  | No log        | 5.0   | 210   | 0.8380          |
  | No log        | 6.0   | 252   | 0.8109          |
  | No log        | 7.0   | 294   | 0.7886          |
  | No log        | 8.0   | 336   | 0.7760          |
  | No log        | 9.0   | 378   | 0.7577          |
  | No log        | 10.0  | 420   | 0.7483          |
  | No log        | 11.0  | 462   | 0.7364          |
  | 1.2044        | 12.0  | 504   | 0.7267          |
  | 1.2044        | 13.0  | 546   | 0.7205          |
  | 1.2044        | 14.0  | 588   | 0.7102          |
  | 1.2044        | 15.0  | 630   | 0.7048          |
  | 1.2044        | 16.0  | 672   | 0.7015          |
  | 1.2044        | 17.0  | 714   | 0.6958          |
  | 1.2044        | 18.0  | 756   | 0.6892          |
  | 1.2044        | 19.0  | 798   | 0.6877          |
  | 1.2044        | 20.0  | 840   | 0.6825          |
  | 1.2044        | 21.0  | 882   | 0.6790          |
  | 1.2044        | 22.0  | 924   | 0.6732          |
  | 1.2044        | 23.0  | 966   | 0.6676          |
  | 0.736         | 24.0  | 1008  | 0.6640          |
  | 0.736         | 25.0  | 1050  | 0.6631          |
  | 0.736         | 26.0  | 1092  | 0.6617          |
  | 0.736         | 27.0  | 1134  | 0.6556          |
  | 0.736         | 28.0  | 1176  | 0.6551          |
  | 0.736         | 29.0  | 1218  | 0.6545          |
  | 0.736         | 30.0  | 1260  | 0.6483          |
  | 0.736         | 31.0  | 1302  | 0.6493          |
  | 0.736         | 32.0  | 1344  | 0.6488          |
  | 0.736         | 33.0  | 1386  | 0.6434          |
  | 0.736         | 34.0  | 1428  | 0.6427          |
  | 0.736         | 35.0  | 1470  | 0.6403          |
  | 0.6568        | 36.0  | 1512  | 0.6364          |
  | 0.6568        | 37.0  | 1554  | 0.6342          |
  | 0.6568        | 38.0  | 1596  | 0.6325          |
  | 0.6568        | 39.0  | 1638  | 0.6300          |
  | 0.6568        | 40.0  | 1680  | 0.6302          |
  | 0.6568        | 41.0  | 1722  | 0.6292          |
  | 0.6568        | 42.0  | 1764  | 0.6264          |
  | 0.6568        | 43.0  | 1806  | 0.6272          |
  | 0.6568        | 44.0  | 1848  | 0.6252          |
  | 0.6568        | 45.0  | 1890  | 0.6229          |
  | 0.6568        | 46.0  | 1932  | 0.6221          |
  | 0.6568        | 47.0  | 1974  | 0.6202          |
  | 0.602         | 48.0  | 2016  | 0.6193          |
  | 0.602         | 49.0  | 2058  | 0.6196          |
  | 0.602         | 50.0  | 2100  | 0.6174          |
  | 0.602         | 51.0  | 2142  | 0.6175          |
  | 0.602         | 52.0  | 2184  | 0.6162          |
  | 0.602         | 53.0  | 2226  | 0.6155          |
  | 0.602         | 54.0  | 2268  | 0.6129          |
  | 0.602         | 55.0  | 2310  | 0.6139          |
  | 0.602         | 56.0  | 2352  | 0.6124          |
  | 0.602         | 57.0  | 2394  | 0.6128          |
  | 0.602         | 58.0  | 2436  | 0.6109          |
  | 0.602         | 59.0  | 2478  | 0.6111          |
  | 0.5653        | 60.0  | 2520  | 0.6097          |
  | 0.5653        | 61.0  | 2562  | 0.6086          |
  | 0.5653        | 62.0  | 2604  | 0.6083          |
  | 0.5653        | 63.0  | 2646  | 0.6086          |
  | 0.5653        | 64.0  | 2688  | 0.6090          |
  | 0.5653        | 65.0  | 2730  | 0.6074          |
  | 0.5653        | 66.0  | 2772  | 0.6064          |
  | 0.5653        | 67.0  | 2814  | 0.6056          |
  | 0.5653        | 68.0  | 2856  | 0.6039          |
  | 0.5653        | 69.0  | 2898  | 0.6051          |
  | 0.5653        | 70.0  | 2940  | 0.6043          |
  | 0.5653        | 71.0  | 2982  | 0.6034          |
  | 0.5368        | 72.0  | 3024  | 0.6020          |
  | 0.5368        | 73.0  | 3066  | 0.6047          |
  | 0.5368        | 74.0  | 3108  | 0.6031        