lamaabdulaziz commited on
Commit
2f2877d
·
1 Parent(s): 04f4f50

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -15
README.md CHANGED
@@ -17,11 +17,11 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [aubmindlab/aragpt2-mega-detector-long](https://huggingface.co/aubmindlab/aragpt2-mega-detector-long) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.6113
21
- - Macro F1: 0.7072
22
- - Accuracy: 0.7175
23
- - Precision: 0.7090
24
- - Recall: 0.7059
25
 
26
  ## Model description
27
 
@@ -41,28 +41,28 @@ More information needed
41
 
42
  The following hyperparameters were used during training:
43
  - learning_rate: 2e-05
44
- - train_batch_size: 16
45
- - eval_batch_size: 16
46
  - seed: 25
47
  - gradient_accumulation_steps: 2
48
- - total_train_batch_size: 32
49
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
  - lr_scheduler_type: linear
51
- - num_epochs: 4
52
 
53
  ### Training results
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Macro F1 | Accuracy | Precision | Recall |
56
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|:---------:|:------:|
57
- | 0.5809 | 1.0 | 1597 | 0.5598 | 0.6997 | 0.7069 | 0.6990 | 0.7006 |
58
- | 0.4958 | 2.0 | 3194 | 0.5369 | 0.7012 | 0.7224 | 0.7212 | 0.6973 |
59
- | 0.4376 | 3.0 | 4791 | 0.5769 | 0.7042 | 0.7083 | 0.7036 | 0.7085 |
60
- | 0.3993 | 4.0 | 6388 | 0.6113 | 0.7072 | 0.7175 | 0.7090 | 0.7059 |
61
 
62
 
63
  ### Framework versions
64
 
65
- - Transformers 4.12.2
66
  - Pytorch 1.11.0
67
  - Datasets 2.1.0
68
- - Tokenizers 0.10.3
 
17
 
18
  This model is a fine-tuned version of [aubmindlab/aragpt2-mega-detector-long](https://huggingface.co/aubmindlab/aragpt2-mega-detector-long) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.5249
21
+ - Macro F1: 0.7536
22
+ - Accuracy: 0.7626
23
+ - Precision: 0.7563
24
+ - Recall: 0.7517
25
 
26
  ## Model description
27
 
 
41
 
42
  The following hyperparameters were used during training:
43
  - learning_rate: 2e-05
44
+ - train_batch_size: 32
45
+ - eval_batch_size: 32
46
  - seed: 25
47
  - gradient_accumulation_steps: 2
48
+ - total_train_batch_size: 64
49
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
  - lr_scheduler_type: linear
51
+ - num_epochs: 5
52
 
53
  ### Training results
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Macro F1 | Accuracy | Precision | Recall |
56
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|:---------:|:------:|
57
+ | 0.588 | 1.0 | 798 | 0.5131 | 0.7235 | 0.7384 | 0.7341 | 0.7197 |
58
+ | 0.462 | 2.0 | 1596 | 0.5112 | 0.7408 | 0.7574 | 0.7587 | 0.7357 |
59
+ | 0.4034 | 3.0 | 2394 | 0.5249 | 0.7536 | 0.7626 | 0.7563 | 0.7517 |
60
+ | 0.3234 | 4.0 | 3192 | 0.5967 | 0.7524 | 0.7585 | 0.7516 | 0.7534 |
61
 
62
 
63
  ### Framework versions
64
 
65
+ - Transformers 4.20.1
66
  - Pytorch 1.11.0
67
  - Datasets 2.1.0
68
+ - Tokenizers 0.12.1