To provide a method and a device that can avoid a case where a score by automatic evaluation is high but ease to understand is low when performing total evaluation of a translation.SOLUTION: A method includes the steps of: acquiring a translation to be evaluated and a reference translation; acquiring a word meaning similarity between the translation to be evaluated and the reference translation by inputting the translation to be evaluated and the reference translation into a preliminarily trained repetition coding model, which is a neural network for calculating the probability that a pair of sentences is a repetitive sentence; defining a text similarity between the translation to be evaluated and the reference translation by calculating the similarity of two syntax trees; and defining the sum of weighting of the word meaning similarity and the text similarity as a score of translation quality.SELECTED DRAWING: Figure 2
METHOD AND DEVICE FOR EVALUATING TRANSLATION QUALITY