Though we could have used a further downstream measure like BLEU , METEOR has also been shown to directly correlate with translation quality ( Banerjee and Lavie , 2005 ) and is simpler to measure .
meteor an automatic metric for mt evaluation with improved correlation with human judgments
S Banerjee A Lavie
We use a reordering score based on the reordering penalty from the METEOR scoring metric . Though we could have used a further downstream measure like BLEU , METEOR has also been shown to directly correlate with translation quality ( Banerjee and Lavie , 2005 ) and is simpler to measure . All reordering augmented-loss experiments are run with the same treebank data as the baseline ( the training portions of PTB , Brown , and QTB ) .
Though we could have used a further downstream measure like BLEU , METEOR has also been shown to directly correlate with translation quality ( @@CITATION ) and is simpler to measure .