The statistical significance test is performed by the re-sampling approach ( Koehn , 2004 ) .
statistical significance tests for machine translation evaluation
Philipp Koehn
The translation quality is evaluated by case-insensitive BLEU-4 with the shortest length penalty . The statistical significance test is performed by the re-sampling approach ( Koehn , 2004 ) . To create the baseline system , we use the opensource Joshua 4.0 system ( Ganitkevitch et al. , 2012 ) to build a hierarchical phrase-based ( HPB ) system , and a syntax-augmented MT ( SAMT ) 11 system ( Zollmann and Venugopal , 2006 ) respectively .
The statistical significance test is performed by the re-sampling approach ( @@CITATION ) .