hungnm commited on
Commit
31d3d96
·
verified ·
1 Parent(s): 8e29cf7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +36 -19
README.md CHANGED
@@ -1,20 +1,20 @@
1
- ---
2
- library_name: transformers
3
- license: apache-2.0
4
- base_model: answerdotai/ModernBERT-base
5
- tags:
6
- - generated_from_trainer
7
- metrics:
8
- - accuracy
9
- model-index:
10
- - name: Fin-ModernBERT
11
- results: []
12
- datasets:
13
- - clapAI/FinData-dedup
14
- language:
15
- - en
16
- pipeline_tag: fill-mask
17
- ---
18
 
19
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
20
  should probably proofread and complete it, then remove this comment. -->
@@ -71,9 +71,26 @@ The following hyperparameters were used during training:
71
 
72
  ## Evaluation Benchmarks
73
 
74
- We evaluated **Fin-ModernBERT** on financial NLP benchmarks and compared it against general-purpose pretrained models:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
75
 
76
- Updating
77
 
78
 
79
  ---
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: answerdotai/ModernBERT-base
5
+ tags:
6
+ - generated_from_trainer
7
+ metrics:
8
+ - accuracy
9
+ model-index:
10
+ - name: Fin-ModernBERT
11
+ results: []
12
+ datasets:
13
+ - clapAI/FinData-dedup
14
+ language:
15
+ - en
16
+ pipeline_tag: fill-mask
17
+ ---
18
 
19
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
20
  should probably proofread and complete it, then remove this comment. -->
 
71
 
72
  ## Evaluation Benchmarks
73
 
74
+ We benchmarked **Fin-ModernBERT** against two strong baselines:
75
+ - [ProsusAI/finbert](https://huggingface.co/ProsusAI/finbert)
76
+ - [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base)
77
+
78
+ ### Fine-tuning Setup
79
+ All models were fine-tuned under the same configuration:
80
+ - **Optimizer:** AdamW
81
+ - **Learning rate:** 5e-5
82
+ - **Batch size:** 16
83
+ - **Epochs:** 5
84
+ - **Scheduler:** Linear
85
+
86
+ ### Results
87
+
88
+ | Dataset | Metric | FinBERT (ProsusAI) | ModernBERT-base | Fin-ModernBERT |
89
+ |---------|--------|---------------------|-----------------|----------------|
90
+ | CIKM (datht/fin-cikm) | F1-score | 42.77 | 53.08 | **54.89** |
91
+ | PhraseBank (soumakchak/phrasebank) | F1-score | 86.33 | 85.03 | **88.09** |
92
 
93
+ > Further evaluations on additional datasets and tasks are ongoing to provide a more comprehensive view of its performance.
94
 
95
 
96
  ---