Preliminary WMT24 Ranking of General MT Systems and LLMs
<|reference_start|>Preliminary WMT24 Ranking of General MT Systems and LLMs: This is the preliminary ranking of WMT24 General MT systems based on automatic metrics. The official ranking will be a human evaluation, which is superior to the automatic ranking and supersedes it. The purpose of this report is not to interpret any findings but only provide preliminary results to the participants of the General MT task that may be useful during the writing of the system submission.<|reference_end|>
@article{kocmi2024preliminary,
    title={Preliminary WMT24 Ranking of General MT Systems and LLMs},
    author={Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton
  Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda,
  Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Benjamin
  Marie, Kenton Murray, Masaaki Nagata, Martin Popel, Maja Popovic, Mariya
  Shmatova, Stein{th}'or Steingr'imsson, Vil'em Zouhar},
    journal={arXiv preprint arXiv:2407.19884},
    year={2024},
    archivePrefix={arXiv},
    eprint={2407.19884},
    primaryClass={cs.CL}
}