Language Translation, Large Language Models, Research, Generative Ai Tools, Thoughts And Theory.
How do we tell if GEMBA is performing better than conventional metrics such as BLEU and COMET? A: If GEMBA scores corresponds closely with what a human thinks of the translation, we have a winner! To operationalize that answer, there are two metrics (Kendall’s Tau and Accuracy (accuracy, Kocmi et