Add Comet
Browse files
README.md
CHANGED
|
@@ -418,6 +418,7 @@ An exception is the English to Bhojpuri direction, which is not included in the
|
|
| 418 |
|
| 419 |
- `BLEU`: Sacrebleu implementation. Signature: nrefs:1— case:mixed— eff:no— tok:13a— smooth:exp—version:2.3.1
|
| 420 |
- `ChrF`: Sacrebleu implementation.
|
|
|
|
| 421 |
- `Comet-kiwi`: Model checkpoint: "Unbabel/wmt22-cometkiwi-da".
|
| 422 |
- `Bleurt`: Model checkpoint: "lucadiliello/BLEURT-20".
|
| 423 |
- `MetricX`: Model checkpoint: "google/metricx-23-xl-v2p0".
|
|
@@ -452,6 +453,19 @@ This section presents the ChrF scores on the WMT++ test set.
|
|
| 452 |
|
| 453 |
</details>
|
| 454 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 455 |
<details>
|
| 456 |
<summary>Comet-Kiwi</summary>
|
| 457 |
|
|
|
|
| 418 |
|
| 419 |
- `BLEU`: Sacrebleu implementation. Signature: nrefs:1— case:mixed— eff:no— tok:13a— smooth:exp—version:2.3.1
|
| 420 |
- `ChrF`: Sacrebleu implementation.
|
| 421 |
+
- `Comet`: Model checkpoint: "Unbabel/wmt22-comet-da".
|
| 422 |
- `Comet-kiwi`: Model checkpoint: "Unbabel/wmt22-cometkiwi-da".
|
| 423 |
- `Bleurt`: Model checkpoint: "lucadiliello/BLEURT-20".
|
| 424 |
- `MetricX`: Model checkpoint: "google/metricx-23-xl-v2p0".
|
|
|
|
| 453 |
|
| 454 |
</details>
|
| 455 |
|
| 456 |
+
<details>
|
| 457 |
+
<summary>Comet</summary>
|
| 458 |
+
|
| 459 |
+
#### Comet
|
| 460 |
+
|
| 461 |
+
This section presents the Comet scores on the WMT++ test set.
|
| 462 |
+
|
| 463 |
+
<a href="https://huggingface.co/LangTech-MT/salamandraTA-7b-instruct-WMT25/blob/main/images/eval_comet.png" target="_blank">
|
| 464 |
+
<img src="./images/eval_comet.png" alt="Comet"/>
|
| 465 |
+
</a>
|
| 466 |
+
|
| 467 |
+
</details>
|
| 468 |
+
|
| 469 |
<details>
|
| 470 |
<summary>Comet-Kiwi</summary>
|
| 471 |
|