readme: ---
  license: mit
  tags:
  - generated_from_trainer
  metrics:
  - rouge
  model-index:
  - name: bart-cnn-pubmed-arxiv-pubmed-v3-e43
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # bart-cnn-pubmed-arxiv-pubmed-v3-e43
  
  This model is a fine-tuned version of [theojolliffe/bart-cnn-pubmed-arxiv-pubmed](https://huggingface.co/theojolliffe/bart-cnn-pubmed-arxiv-pubmed) on an unknown dataset.
  It achieves the following results on the evaluation set:
  - Loss: 1.0837
  - Rouge1: 58.1526
  - Rouge2: 46.0425
  - Rougel: 49.5624
  - Rougelsum: 56.9295
  - Gen Len: 142.0
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 2e-05
  - train_batch_size: 1
  - eval_batch_size: 1
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 43
  - mixed_precision_training: Native AMP
  
  ### Training results
  
  | Training Loss | Epoch | Step  | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum | Gen Len  |
  |:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:--------:|
  | 1.2542        | 1.0   | 795   | 0.9354          | 51.4655 | 31.6464 | 34.2376 | 48.9765   | 141.963  |
  | 0.7019        | 2.0   | 1590  | 0.8119          | 53.3066 | 34.683  | 36.4262 | 50.907    | 142.0    |
  | 0.5251        | 3.0   | 2385  | 0.7839          | 52.4248 | 32.8685 | 36.0084 | 49.9957   | 142.0    |
  | 0.3449        | 4.0   | 3180  | 0.7673          | 52.716  | 34.7869 | 38.4201 | 50.8384   | 142.0    |
  | 0.2666        | 5.0   | 3975  | 0.7647          | 54.6433 | 37.1337 | 40.1459 | 52.4288   | 141.7778 |
  | 0.1805        | 6.0   | 4770  | 0.8400          | 53.5747 | 36.001  | 39.5984 | 51.1935   | 141.8148 |
  | 0.1413        | 7.0   | 5565  | 0.7925          | 53.9875 | 37.01   | 40.6532 | 51.9353   | 142.0    |
  | 0.113         | 8.0   | 6360  | 0.7665          | 56.395  | 41.5764 | 44.327  | 54.7845   | 142.0    |
  | 0.0907        | 9.0   | 7155  | 0.8442          | 55.1407 | 39.4113 | 43.0628 | 53.6503   | 142.0    |
  | 0.0824        | 10.0  | 7950  | 0.8469          | 55.7103 | 40.6761 | 43.3754 | 53.8227   | 142.0    |
  | 0.0639        | 11.0  | 8745  | 0.8892          | 56.0839 | 40.6204 | 43.2455 | 54.4412   | 142.0    |
  | 0.0504        | 12.0  | 9540  | 0.8613          | 56.9634 | 42.8236 | 45.4255 | 55.4026   | 142.0    |
  | 0.0447        | 13.0  | 10335 | 0.9341          | 57.7216 | 44.104  | 47.1429 | 56.4299   | 142.0    |
  | 0.0396        | 14.0  | 11130 | 0.9203          | 56.2073 | 42.9575 | 45.8068 | 54.8089   | 142.0    |
  | 0.036         | 15.0  | 11925 | 0.9253          | 58.5212 | 45.6047 | 49.1205 | 57.0551   | 142.0    |
  | 0.0302        | 16.0  | 12720 | 0.9187          | 58.8046 | 46.0106 | 48.0442 | 57.2799   | 142.0    |
  | 0.0261        | 17.0  | 13515 | 0.9578          | 57.3405 | 43.8227 | 46.6317 | 55.7836   | 142.0    |
  | 0.0231        | 18.0  | 14310 | 0.9578          | 57.7604 | 44.6164 | 47.8902 | 56.2309   | 141.8148 |
  | 0.0198        | 19.0  | 15105 | 0.9662          | 57.774  | 44.6407 | 47.5489 | 56.1936   | 142.0    |
  | 0.0165        | 20.0  | 15900 | 0.9509          | 59.6297 | 46.5076 | 48.3507 | 58.083    | 142.0    |
  | 0.0145        | 21.0  | 16695 | 0.9915          | 58.2245 | 45.1804 | 48.1191 | 56.889    | 142.0    |
  | 0.0128        | 22.0  | 17490 | 0.9945          | 58.2646 | 46.2782 | 49.4411 | 56.992    | 142.0    |
  | 0.0129        | 23.0  | 18285 | 1.0069          | 57.0055 | 44.1866 | 46.9101 | 55.5056   | 141.9444 |
  | 0.0116        | 24.0  | 19080 | 0.9967          | 58.1091 | 45.5303 | 48.2208 | 56.4496   | 142.0    |
  | 0.0093        | 25.0  | 19875 | 1.0188          | 56.59   | 43.677  | 45.8956 | 55.0954   | 142.0    |
  | 0.008         | 26.0  | 20670 | 0.9976          | 58.5408 | 46.7019 | 48.9235 | 57.2562   | 142.0    |
  | 0.0077        | 27.0  | 21465 | 1.0123          | 57.7909 | 45.7619 | 48.3412 | 56.3796   | 142.0    |
  | 0.0075        | 28.0  | 22260 | 1.0258          | 58.1694 | 45.03   | 48.282  | 56.7303   | 142.0    |
  | 0.0056        | 29.0  | 23055 | 1.0100          | 58.0406 | 45.37   | 48.0125 | 56.5288   | 142.0    |
  | 0.0049        | 30.0  | 23850 | 1.0235          | 56.419  | 43.248  | 46.3448 | 54.8467   | 142.0    |
  | 0.0042        | 31.0  | 24645 | 1.0395          | 57.7232 | 45.6305 | 48.4531 | 56.3343   | 141.9444 |
  | 0.0034        | 32.0  | 25440 | 1.0605          | 58.9049 | 46.8049 | 49.9103 | 57.6751   | 141.5    |
  | 0.0032        | 33.0  | 26235 | 1.0362          | 57.8681 | 45.9028 | 48.8624 | 56.5616   | 141.8704 |
  | 0.0025        | 34.0  | 27030 | 1.0521          | 58.8985 | 46.8547 | 49.8485 | 57.4249   | 142.0    |
  |