sergiopaniego HF Staff commited on
Commit
41f13b8
·
verified ·
1 Parent(s): e793226

End of training

Browse files
Files changed (1) hide show
  1. README.md +18 -2
README.md CHANGED
@@ -4,6 +4,8 @@ license: apache-2.0
4
  base_model: answerdotai/ModernBERT-base
5
  tags:
6
  - generated_from_trainer
 
 
7
  model-index:
8
  - name: modernbert-banking77
9
  results: []
@@ -15,6 +17,9 @@ should probably proofread and complete it, then remove this comment. -->
15
  # modernbert-banking77
16
 
17
  This model is a fine-tuned version of [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on an unknown dataset.
 
 
 
18
 
19
  ## Model description
20
 
@@ -34,13 +39,24 @@ More information needed
34
 
35
  The following hyperparameters were used during training:
36
  - learning_rate: 5e-05
37
- - train_batch_size: 4
38
- - eval_batch_size: 4
39
  - seed: 42
40
  - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
41
  - lr_scheduler_type: linear
42
  - num_epochs: 5
43
 
 
 
 
 
 
 
 
 
 
 
 
44
  ### Framework versions
45
 
46
  - Transformers 4.51.3
 
4
  base_model: answerdotai/ModernBERT-base
5
  tags:
6
  - generated_from_trainer
7
+ metrics:
8
+ - f1
9
  model-index:
10
  - name: modernbert-banking77
11
  results: []
 
17
  # modernbert-banking77
18
 
19
  This model is a fine-tuned version of [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on an unknown dataset.
20
+ It achieves the following results on the evaluation set:
21
+ - Loss: 1.1061
22
+ - F1: 0.7151
23
 
24
  ## Model description
25
 
 
39
 
40
  The following hyperparameters were used during training:
41
  - learning_rate: 5e-05
42
+ - train_batch_size: 16
43
+ - eval_batch_size: 16
44
  - seed: 42
45
  - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
46
  - lr_scheduler_type: linear
47
  - num_epochs: 5
48
 
49
+ ### Training results
50
+
51
+ | Training Loss | Epoch | Step | Validation Loss | F1 |
52
+ |:-------------:|:-----:|:----:|:---------------:|:------:|
53
+ | 3.1629 | 1.0 | 63 | 2.8355 | 0.3096 |
54
+ | 0.6952 | 2.0 | 126 | 1.5412 | 0.6538 |
55
+ | 0.2033 | 3.0 | 189 | 1.2692 | 0.6692 |
56
+ | 0.0118 | 4.0 | 252 | 1.1106 | 0.7039 |
57
+ | 0.0029 | 5.0 | 315 | 1.1061 | 0.7151 |
58
+
59
+
60
  ### Framework versions
61
 
62
  - Transformers 4.51.3