Automatic Evaluation of MT Output and Post-edited MT Output for Genealogically Related Languages

Abstract

The aim of the research is twofold: to evaluate the translation quality of the individual sentences of the MT output and also post-edited MT output on the basis of metrics of automatic MT evaluation from Slovak into the German language; and to compare the quality of MT output and post-edited MT output based on the same automatic metrics of MT evaluation. The icon graphs were used to visualize the results for individual sentences. A significant difference was found in sentence 36 in favor of the post-edited MT output and vice versa in sentence 5 in favor of MT output. Due to the error rate, a significant difference was in sentence 29 and 11 in favor of post-edited MT output and vice versa the sentence 26 in favor of MT output. Based on our results we can state that it is necessary to include into the evaluation of the quality of translation all automatic metrics for each sentence separately.