fahadqazi commited on
Commit
1a71a04
·
verified ·
1 Parent(s): a4916db

End of training

Browse files
Files changed (1) hide show
  1. README.md +4 -17
README.md CHANGED
@@ -5,8 +5,6 @@ language:
5
  base_model: Bhuvana/t5-base-spellchecker
6
  tags:
7
  - generated_from_trainer
8
- metrics:
9
- - rouge
10
  model-index:
11
  - name: T5 Sindhi Spell Checker - Fahad Maqsood Qazi
12
  results: []
@@ -18,13 +16,6 @@ should probably proofread and complete it, then remove this comment. -->
18
  # T5 Sindhi Spell Checker - Fahad Maqsood Qazi
19
 
20
  This model is a fine-tuned version of [Bhuvana/t5-base-spellchecker](https://huggingface.co/Bhuvana/t5-base-spellchecker) on the None dataset.
21
- It achieves the following results on the evaluation set:
22
- - Loss: 3.4755
23
- - Rouge1: 16.5098
24
- - Rouge2: 13.9875
25
- - Rougel: 16.4217
26
- - Rougelsum: 16.5185
27
- - Gen Len: 19.9968
28
 
29
  ## Model description
30
 
@@ -44,22 +35,18 @@ More information needed
44
 
45
  The following hyperparameters were used during training:
46
  - learning_rate: 2e-05
47
- - train_batch_size: 8
48
- - eval_batch_size: 64
49
  - seed: 42
50
- - gradient_accumulation_steps: 8
51
  - total_train_batch_size: 64
52
  - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
53
  - lr_scheduler_type: linear
54
- - training_steps: 2000
55
  - mixed_precision_training: Native AMP
56
 
57
  ### Training results
58
 
59
- | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
60
- |:-------------:|:------:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
61
- | 30.6232 | 0.0138 | 1000 | 3.6027 | 16.3965 | 13.9006 | 16.3126 | 16.4006 | 19.9988 |
62
- | 28.9499 | 0.0276 | 2000 | 3.4755 | 16.5098 | 13.9875 | 16.4217 | 16.5185 | 19.9968 |
63
 
64
 
65
  ### Framework versions
 
5
  base_model: Bhuvana/t5-base-spellchecker
6
  tags:
7
  - generated_from_trainer
 
 
8
  model-index:
9
  - name: T5 Sindhi Spell Checker - Fahad Maqsood Qazi
10
  results: []
 
16
  # T5 Sindhi Spell Checker - Fahad Maqsood Qazi
17
 
18
  This model is a fine-tuned version of [Bhuvana/t5-base-spellchecker](https://huggingface.co/Bhuvana/t5-base-spellchecker) on the None dataset.
 
 
 
 
 
 
 
19
 
20
  ## Model description
21
 
 
35
 
36
  The following hyperparameters were used during training:
37
  - learning_rate: 2e-05
38
+ - train_batch_size: 16
39
+ - eval_batch_size: 100
40
  - seed: 42
41
+ - gradient_accumulation_steps: 4
42
  - total_train_batch_size: 64
43
  - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
44
  - lr_scheduler_type: linear
45
+ - training_steps: 10
46
  - mixed_precision_training: Native AMP
47
 
48
  ### Training results
49
 
 
 
 
 
50
 
51
 
52
  ### Framework versions