readme: ---
  language: en
  tags:
  - summarization
  license: apache-2.0
  datasets:
  - amazon_reviews_multi
  thumbnail: https://huggingface.co/front/thumbnails/distilbart_medium.png
  
  ---
  ### Usage
  
  This checkpoint should be loaded into `BartForConditionalGeneration.from_pretrained`. See the [BART docs](https://huggingface.co/transformers/model_doc/bart.html?#transformers.BartForConditionalGeneration) for more information.
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 2e-05
  - train_batch_size: 4
  - eval_batch_size: 4
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 1
  - mixed_precision_training: Native AMP
  
  ### Training results
  
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel  | Rougelsum | Gen Len |
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:-------:|:---------:|:-------:|
  | 1.2875        | 1.0   | 5754 | 1.6294          | 11.009 | 7.4618 | 10.5573 | 10.8087   | 58.3382 |
  
  
  ### Framework versions
  
  - Transformers 4.19.2
  - Pytorch 1.11.0+cu113
  - Datasets 2.2.2
  - Tokenizers 0.12.1