Julian Mukaj
commited on
Commit
•
2c5f432
1
Parent(s):
5560c81
Initial commit + new eval table
Browse files
README.md
CHANGED
@@ -329,13 +329,13 @@ This is a fine-tuned [sentence-transformers](https://www.SBERT.net) model: It ma
|
|
329 |
This model aims to be very strong on Financial Document Retrieval Tasks, while trying to maintain as much generalized performance as possible.
|
330 |
|
331 |
|
332 |
-
| | FiQA | SciFact | AmazonReviews | OnlineBankingIntent |
|
333 |
-
|
334 |
-
| fin-mpnet-base | 79.91 | 65.40 | 29.12 | 80.25 |
|
335 |
-
| all-mpnet-base-v2 | 49.96 | 65.57 | 31.92 | 81.86 |
|
336 |
-
| previous SoTA | 56.59 |
|
337 |
|
338 |
-
v0.1 shows SoTA results on FiQA Test set while other non-financial benchmarks only drop a few small
|
339 |
|
340 |
|
341 |
## Usage (Sentence-Transformers)
|
|
|
329 |
This model aims to be very strong on Financial Document Retrieval Tasks, while trying to maintain as much generalized performance as possible.
|
330 |
|
331 |
|
332 |
+
| | FiQA | SciFact | AmazonReviews | OnlineBankingIntent | ArguAna |
|
333 |
+
|-------------------|-------|---------|---------------|---------------------|---------|
|
334 |
+
| fin-mpnet-base | 79.91 | 65.40 | 29.12 | 80.25 | 49.11 |
|
335 |
+
| all-mpnet-base-v2 | 49.96 | 65.57 | 31.92 | 81.86 | 46.52 |
|
336 |
+
| previous SoTA | 56.59 | - | - | - | - |
|
337 |
|
338 |
+
v0.1 shows SoTA results on FiQA Test set while other non-financial benchmarks only drop a few small % and improvement in others.
|
339 |
|
340 |
|
341 |
## Usage (Sentence-Transformers)
|