The significance testing is performed by paired bootstrap re-sampling ( Koehn , 2004 ) .
statistical significance tests for machine translation evaluation
Philipp Koehn
In our experiments the translation performances are measured by case-insensitive BLEU4 metric ( Papineni et al. , 2002 ) and we use mtevalv13a.pl as the evaluation tool . The significance testing is performed by paired bootstrap re-sampling ( Koehn , 2004 ) . We use an in-house developed hierarchical phrase-based translation ( Chiang , 2005 ) as our baseline system , and we denote it as In-Hiero .
The significance testing is performed by paired bootstrap re-sampling ( @@CITATION ) .