Commit
•
154a01d
1
Parent(s):
c1f148b
add note about bimedclip performance
Browse files
README.md
CHANGED
|
@@ -18,6 +18,9 @@ The model metrics on the 1,063 samples of the hidden test set of the ACL challen
|
|
| 18 |
| llava1.5-biomedclip-Vicuna-7b | 3.48 | 16.31 | 35.49 | 29.37 | 15.51 | 20.03 |
|
| 19 |
|
| 20 |
|
|
|
|
|
|
|
|
|
|
| 21 |
The metrics were calculated direcly by the challenge organizer, however you can reproduce them with the following
|
| 22 |
example code:
|
| 23 |
|
|
|
|
| 18 |
| llava1.5-biomedclip-Vicuna-7b | 3.48 | 16.31 | 35.49 | 29.37 | 15.51 | 20.03 |
|
| 19 |
|
| 20 |
|
| 21 |
+
When we used BiomedCLIP dfor th challenge, we saw a clear improvement in 6.31 pp for F1-cheXbert compared to the second best
|
| 22 |
+
model in this metric (29.37 vs 23.06).
|
| 23 |
+
|
| 24 |
The metrics were calculated direcly by the challenge organizer, however you can reproduce them with the following
|
| 25 |
example code:
|
| 26 |
|