Update README.md
Browse files
README.md
CHANGED
@@ -284,24 +284,24 @@ full set of data (2900 samples available).
|
|
284 |
|
285 |
#### MLQA-V1 Ger/Eng cross-lingual accuracies for the considered models
|
286 |
|
287 |
-
|# of samples|Pharia4608|GritLM|Nvidia-Embed-v2|
|
288 |
-
|
289 |
-
|1000|86.0%|82.5%|77.0%|
|
290 |
-
|2000|79.5%|73.4%|69.4%|
|
291 |
-
|4000|65.3%|59.2%|56.0%|
|
292 |
-
|6000|54.3%|48.6%|45.6%|
|
293 |
-
|10000|38.6%|32.8%|32.8%|
|
294 |
|
295 |
|
296 |
#### MLQA-V1 Eng/Esp cross-lingual accuracies for the considered models
|
297 |
|
298 |
-
|# samples|Pharia4608|GritLM|NV-Embed-v2|
|
299 |
-
|
300 |
-
|1000|87.5%|82.0%|81.5%|
|
301 |
-
|2000|78.5%|73.9%|70.7%|
|
302 |
-
|4000|65.5%|59.3%|56.9%|
|
303 |
-
|6000|55.3%|49.2%|46.2%|
|
304 |
-
|10000|41.7%|35.5%|33.2%|
|
305 |
|
306 |
#### CLSD-WMT19 Ger/Fra (2900 samples) cross-lingual evaluation for the considered models
|
307 |
|
@@ -311,6 +311,7 @@ full set of data (2900 samples available).
|
|
311 |
|Pharia-1-Embedding-4608-control|95.1% |
|
312 |
|GritLM-7B |94.2% |
|
313 |
|Nvidia-Embed-v2 |93.4% |
|
|
|
314 |
|
315 |
|
316 |
## Training Details
|
|
|
284 |
|
285 |
#### MLQA-V1 Ger/Eng cross-lingual accuracies for the considered models
|
286 |
|
287 |
+
|# of samples|Pharia4608|GritLM|Nvidia-Embed-v2|BGE-Gemma2|
|
288 |
+
|:---:|:---:|:---:|:---:|:---:|
|
289 |
+
|1000|86.0%|82.5%|77.0%|87.0%|
|
290 |
+
|2000|79.5%|73.4%|69.4%|76.8%|
|
291 |
+
|4000|65.3%|59.2%|56.0%|62.7%|
|
292 |
+
|6000|54.3%|48.6%|45.6%|52.6%|
|
293 |
+
|10000|38.6%|32.8%|32.8%|39.4%|
|
294 |
|
295 |
|
296 |
#### MLQA-V1 Eng/Esp cross-lingual accuracies for the considered models
|
297 |
|
298 |
+
|# samples|Pharia4608|GritLM|NV-Embed-v2|BGE-Gemma2|
|
299 |
+
|:---:|:---:|:---:|:---:|:---:|
|
300 |
+
|1000|87.5%|82.0%|81.5%|87.0%|
|
301 |
+
|2000|78.5%|73.9%|70.7%|77.0%|
|
302 |
+
|4000|65.5%|59.3%|56.9%|64.2%|
|
303 |
+
|6000|55.3%|49.2%|46.2%|53.4%|
|
304 |
+
|10000|41.7%|35.5%|33.2%|40.0%|
|
305 |
|
306 |
#### CLSD-WMT19 Ger/Fra (2900 samples) cross-lingual evaluation for the considered models
|
307 |
|
|
|
311 |
|Pharia-1-Embedding-4608-control|95.1% |
|
312 |
|GritLM-7B |94.2% |
|
313 |
|Nvidia-Embed-v2 |93.4% |
|
314 |
+
|BGE-Gemma2 |95.4% |
|
315 |
|
316 |
|
317 |
## Training Details
|