Julian Mukaj commited on
Commit
2c5f432
1 Parent(s): 5560c81

Initial commit + new eval table

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -329,13 +329,13 @@ This is a fine-tuned [sentence-transformers](https://www.SBERT.net) model: It ma
329
  This model aims to be very strong on Financial Document Retrieval Tasks, while trying to maintain as much generalized performance as possible.
330
 
331
 
332
- | | FiQA | SciFact | AmazonReviews | OnlineBankingIntent |
333
- |-------------------|-------|---------|---------------|---------------------|
334
- | fin-mpnet-base | 79.91 | 65.40 | 29.12 | 80.25 |
335
- | all-mpnet-base-v2 | 49.96 | 65.57 | 31.92 | 81.86 |
336
- | previous SoTA | 56.59 | | | |
337
 
338
- v0.1 shows SoTA results on FiQA Test set while other non-financial benchmarks only drop a few small %.
339
 
340
 
341
  ## Usage (Sentence-Transformers)
 
329
  This model aims to be very strong on Financial Document Retrieval Tasks, while trying to maintain as much generalized performance as possible.
330
 
331
 
332
+ | | FiQA | SciFact | AmazonReviews | OnlineBankingIntent | ArguAna |
333
+ |-------------------|-------|---------|---------------|---------------------|---------|
334
+ | fin-mpnet-base | 79.91 | 65.40 | 29.12 | 80.25 | 49.11 |
335
+ | all-mpnet-base-v2 | 49.96 | 65.57 | 31.92 | 81.86 | 46.52 |
336
+ | previous SoTA | 56.59 | - | - | - | - |
337
 
338
+ v0.1 shows SoTA results on FiQA Test set while other non-financial benchmarks only drop a few small % and improvement in others.
339
 
340
 
341
  ## Usage (Sentence-Transformers)