fdzaitana commited on
Commit
c525177
·
verified ·
1 Parent(s): c45d929

Training complete

Browse files
Files changed (2) hide show
  1. README.md +7 -8
  2. generation_config.json +5 -0
README.md CHANGED
@@ -1,7 +1,6 @@
1
  ---
2
  library_name: transformers
3
- license: apache-2.0
4
- base_model: google-t5/t5-small
5
  tags:
6
  - simplification
7
  - generated_from_trainer
@@ -17,11 +16,11 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  # t5-normalization
19
 
20
- This model is a fine-tuned version of [google-t5/t5-small](https://huggingface.co/google-t5/t5-small) on an unknown dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 0.1709
23
- - Bleu: 52.1285
24
- - Gen Len: 18.5417
25
 
26
  ## Model description
27
 
@@ -52,8 +51,8 @@ The following hyperparameters were used during training:
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
54
  |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|
55
- | No log | 1.0 | 440 | 0.1950 | 52.8189 | 18.5417 |
56
- | 0.2883 | 2.0 | 880 | 0.1709 | 52.1285 | 18.5417 |
57
 
58
 
59
  ### Framework versions
 
1
  ---
2
  library_name: transformers
3
+ base_model: google/pegasus-large
 
4
  tags:
5
  - simplification
6
  - generated_from_trainer
 
16
 
17
  # t5-normalization
18
 
19
+ This model is a fine-tuned version of [google/pegasus-large](https://huggingface.co/google/pegasus-large) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.0924
22
+ - Bleu: 87.9207
23
+ - Gen Len: 36.5
24
 
25
  ## Model description
26
 
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
53
  |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|
54
+ | No log | 1.0 | 440 | 0.1099 | 87.5309 | 36.25 |
55
+ | 0.2393 | 2.0 | 880 | 0.0924 | 87.9207 | 36.5 |
56
 
57
 
58
  ### Framework versions
generation_config.json CHANGED
@@ -1,6 +1,11 @@
1
  {
 
2
  "decoder_start_token_id": 0,
3
  "eos_token_id": 1,
 
 
 
 
4
  "pad_token_id": 0,
5
  "transformers_version": "4.50.0"
6
  }
 
1
  {
2
+ "bos_token_id": 0,
3
  "decoder_start_token_id": 0,
4
  "eos_token_id": 1,
5
+ "forced_eos_token_id": 1,
6
+ "length_penalty": 0.8,
7
+ "max_length": 256,
8
+ "num_beams": 8,
9
  "pad_token_id": 0,
10
  "transformers_version": "4.50.0"
11
  }