readme: ---
  license: apache-2.0
  tags:
  - generated_from_trainer
  model-index:
  - name: summarise_v10
    results: []
  ---
  
  ![SGH logo.png](https://s3.amazonaws.com/moonup/production/uploads/1667143139655-631feef1124782a19eff4243.png)
  
  This model is a fine-tuned version of [allenai/led-base-16384](https://huggingface.co/allenai/led-base-16384) on the SGH news articles and summaries dataset.
  It achieves the following results on the evaluation set:
  - Loss: 1.9680
  - Rouge1 Precision: 0.4404
  - Rouge1 Recall: 0.5874
  - Rouge1 Fmeasure: 0.4653
  - Rouge2 Precision: 0.2673
  - Rouge2 Recall: 0.3871
  - Rouge2 Fmeasure: 0.2897
  - Rougel Precision: 0.3059
  - Rougel Recall: 0.4418
  - Rougel Fmeasure: 0.3308
  - Rougelsum Precision: 0.3059
  - Rougelsum Recall: 0.4418
  - Rougelsum Fmeasure: 0.3308
  
  ## Model description
  
  This model was created to generate summaries of news articles.
  
  ## Intended uses & limitations
  
  The model takes up to maximum article length of 3072 tokens and generates a summary of maximum length of 512 tokens, and minimum length of 100 tokens.
  
  ## Training and evaluation data
  
  This model was trained on 100+ articles and summaries from SGH.
  
  ### Training hyperparameters
  
  The following hyperparameters were used during training:
  - learning_rate: 5e-05
  - train_batch_size: 4
  - eval_batch_size: 4
  - seed: 42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  - lr_scheduler_type: linear
  - num_epochs: 10
  - mixed_precision_training: Native AMP
  
  ### Training results
  
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 Precision | Rouge1 Recall | Rouge1 Fmeasure | Rouge2 Precision | Rouge2 Recall | Rouge2 Fmeasure | Rougel Precision | Rougel Recall | Rougel Fmeasure | Rougelsum Precision | Rougelsum Recall | Rougelsum Fmeasure |
  |:-------------:|:-----:|:----:|:---------------:|:----------------:|:-------------:|:---------------:|:----------------:|:-------------:|:---------------:|:----------------:|:-------------:|:---------------:|:-------------------:|:----------------:|:------------------:|
  | 1.4834        | 0.43  | 10   | 1.7001          | 0.2304           | 0.6761        | 0.3152          | 0.1326           | 0.4034        | 0.1797          | 0.1495           | 0.4624        | 0.2069          | 0.1495              | 0.4624           | 0.2069             |
  | 1.5011        | 0.87  | 20   | 1.6051          | 0.4301           | 0.5372        | 0.4087          | 0.2481           | 0.3439        | 0.245           | 0.2878           | 0.3928        | 0.2834          | 0.2878              | 0.3928           | 0.2834             |
  | 0.9289        | 1.3   | 30   | 1.5501          | 0.431            | 0.597         | 0.4364          | 0.2653           | 0.393         | 0.2736          | 0.3007           | 0.4233        | 0.3037          | 0.3007              | 0.4233           | 0.3037             |
  | 1.0895        | 1.74  | 40   | 1.5969          | 0.4661           | 0.5481        | 0.4486          | 0.2736           | 0.3439        | 0.2689          | 0.3318           | 0.4045        | 0.3221          | 0.3318              | 0.4045           | 0.3221             |
  | 0.7785        | 2.17  | 50   | 1.5875          | 0.4527           | 0.5405        | 0.4209          | 0.2942           | 0.3634        | 0.272           | 0.3268           | 0.4047        | 0.3042          | 0.3268              | 0.4047           | 0.3042             |
  | 0.635         | 2.61  | 60   | 1.6081          | 0.4142           | 0.5649        | 0.4172          | 0.242            | 0.3659        | 0.2549          | 0.2787           | 0.4156        | 0.2909          | 0.2787              | 0.4156           | 0.2909             |
  | 0.514         | 3.04  | 70   | 1.6150          | 0.4431           | 0.5665        | 0.4569          | 0.2656           | 0.3754        | 0.2853          | 0.3252           | 0.441         | 0.3434          | 0.3252              | 0.441            | 0.3434             |
  | 0.5617        | 3.48  | 80   | 1.6447          | 0.3956           | 0.6304        | 0.451           | 0.2353           | 0.425         | 0.2776          | 0.2883           | 0.4904        | 0.3332          | 0.2883              | 0.4904           | 0.3332             |
  | 0.396         | 3.91  | 90   | 1.7423          | 0.4276           | 0.609         | 0.4506          | 0.2657           | 0.4142        | 0.2858          | 0.3091           | 0.4677        | 0.3316          | 0.3091              | 0.4677           | 0.3316             |
  | 0.3427        | 4.35  | 100  | 1.7572          | 0.3877           | 0.5633        | 0.4169          | 0.216            | 0.3635        | 0.2468          | 0.2706           | 0.4314        | 0.3018          | 0.2706              | 0.4314           | 0.3018             |
  | 0.3059        | 4.78  | 110  | 1.7705          | 0.4255           | 0.5524        | 0.4429          | 0.2495           | 0.3488        | 0.2671          | 0.3184           | 0.4275        | 0.3358          | 0.3184              | 0.4275           | 0.3358            