readme: ---
  license: mit
  tags:
  - generated_from_trainer
  metrics:
  - rouge
  model-index:
  - name: bart-cnn-pubmed-arxiv-pubmed-v3-e64
    results: []
  ---
  
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
  should probably proofread and complete it, then remove this comment. -->
  
  # bart-cnn-pubmed-arxiv-pubmed-v3-e64
  
  This model is a fine-tuned version of [theojolliffe/bart-cnn-pubmed-arxiv-pubmed](https://huggingface.co/theojolliffe/bart-cnn-pubmed-arxiv-pubmed) on an unknown dataset.
  It achieves the following results on the evaluation set:
  - Loss: 1.0630
  - Rouge1: 58.7
  - Rouge2: 47.8042
  - Rougel: 50.6967
  - Rougelsum: 57.5543
  - Gen Len: 142.0
  
  ## Model description
  
  More information needed
  
  ## Intended uses & limitations
  
  More information needed
  
  ## Training and evaluation data
  
  More information needed
  
  ## Training procedure
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 2e-05
  - train_batch_size: 2
  - eval_batch_size: 2
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 64
  - mixed_precision_training: Native AMP
  
  ### Training results
  
  | Training Loss | Epoch | Step  | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum | Gen Len  |
  |:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:--------:|
  | No log        | 1.0   | 398   | 0.9499          | 53.8396 | 34.0954 | 35.6734 | 51.3453   | 142.0    |
  | 1.1219        | 2.0   | 796   | 0.8223          | 53.0414 | 33.3193 | 35.7448 | 50.1675   | 142.0    |
  | 0.6681        | 3.0   | 1194  | 0.7689          | 53.6684 | 35.3651 | 37.7087 | 51.1441   | 142.0    |
  | 0.4393        | 4.0   | 1592  | 0.7694          | 53.9066 | 35.3925 | 38.8917 | 51.6172   | 142.0    |
  | 0.4393        | 5.0   | 1990  | 0.7597          | 54.0746 | 36.1026 | 39.1318 | 51.9272   | 142.0    |
  | 0.2947        | 6.0   | 2388  | 0.8284          | 53.1168 | 34.7428 | 38.0573 | 50.9563   | 142.0    |
  | 0.2016        | 7.0   | 2786  | 0.7951          | 55.7222 | 39.0458 | 42.5265 | 53.5359   | 142.0    |
  | 0.1422        | 8.0   | 3184  | 0.7793          | 56.2376 | 40.3348 | 43.435  | 54.3228   | 142.0    |
  | 0.1096        | 9.0   | 3582  | 0.8260          | 55.0372 | 39.0552 | 42.5403 | 53.0694   | 142.0    |
  | 0.1096        | 10.0  | 3980  | 0.8397          | 53.849  | 37.519  | 40.674  | 52.1357   | 141.7037 |
  | 0.0881        | 11.0  | 4378  | 0.8504          | 56.4835 | 41.0484 | 44.9407 | 54.3557   | 142.0    |
  | 0.0693        | 12.0  | 4776  | 0.8285          | 55.7705 | 39.8585 | 43.722  | 53.7607   | 142.0    |
  | 0.0572        | 13.0  | 5174  | 0.8327          | 57.932  | 43.5378 | 46.8233 | 55.8739   | 142.0    |
  | 0.0461        | 14.0  | 5572  | 0.8720          | 57.6733 | 42.9742 | 45.8698 | 56.018    | 142.0    |
  | 0.0461        | 15.0  | 5970  | 0.8723          | 57.6072 | 42.6946 | 45.2551 | 55.8486   | 142.0    |
  | 0.0416        | 16.0  | 6368  | 0.8764          | 57.1973 | 43.1931 | 46.4492 | 55.3842   | 142.0    |
  | 0.0343        | 17.0  | 6766  | 0.8638          | 57.4474 | 43.3544 | 46.3026 | 55.7863   | 142.0    |
  | 0.03          | 18.0  | 7164  | 0.9234          | 57.9166 | 43.8551 | 46.6473 | 56.3895   | 142.0    |
  | 0.0252        | 19.0  | 7562  | 0.9393          | 58.2908 | 45.2321 | 47.1398 | 56.6618   | 142.0    |
  | 0.0252        | 20.0  | 7960  | 0.8966          | 59.2798 | 46.381  | 49.3514 | 57.6061   | 142.0    |
  | 0.024         | 21.0  | 8358  | 0.9056          | 57.8409 | 44.2048 | 47.3329 | 56.2568   | 142.0    |
  | 0.0195        | 22.0  | 8756  | 0.9424          | 57.551  | 44.6847 | 47.2771 | 56.2391   | 142.0    |
  | 0.0182        | 23.0  | 9154  | 0.9361          | 59.1078 | 46.4704 | 49.4178 | 57.6796   | 142.0    |
  | 0.0169        | 24.0  | 9552  | 0.9456          | 56.7966 | 43.3135 | 46.4208 | 55.4646   | 142.0    |
  | 0.0169        | 25.0  | 9950  | 0.9867          | 59.5561 | 47.4638 | 50.0725 | 58.2388   | 141.8519 |
  | 0.0147        | 26.0  | 10348 | 0.9727          | 58.2574 | 44.9904 | 47.2701 | 56.4274   | 142.0    |
  | 0.0125        | 27.0  | 10746 | 0.9589          | 58.6792 | 45.8465 | 48.0781 | 57.0755   | 142.0    |
  | 0.0117        | 28.0  | 11144 | 0.9635          | 59.1118 | 46.6614 | 50.0552 | 57.6153   | 142.0    |
  | 0.0103        | 29.0  | 11542 | 0.9623          | 58.2517 | 45.6401 | 48.5888 | 56.7733   | 142.0    |
  | 0.0103        | 30.0  | 11940 | 0.9752          | 59.0707 | 47.203  | 49.7992 | 57.6216   | 142.0    |
  | 0.0096        | 31.0  | 12338 | 0.9610          | 57.6781 | 44.0504 | 47.6718 | 56.1201   | 142.0    |
  | 0.0089        | 32.0  | 12736 | 0.9705          | 58.5592 | 45.7397 | 48.681  | 57.0302   | 142.0    |
  | 0.008         | 33.0  | 13134 | 0.9989          | 58.1997 | 45.6345 | 48.2551 | 56.8571   | 141.7778 |
  | 0.0075        | 34.0  | 13532 | 0.9880          | 57.9632 | 44.7845 | 47.8763 | 56.3979   | 142.0    |
  | 0.