Automatic Evaluation for Machine Translation

Abstract

Language is the primary mode of communication. Communication is the only way to convey our thoughts and emotions to others. But there are many languages that we don't know how to speak and we can't learn all languages so quickly which is why Machine Translation systems were invented to help us communicate with anyone from anywhere. Researchers started working on Machine Translation Systems in the 1950s and have developed various amazing techniques to make our communication easy. Machine Translation Evaluation (MTE) Methodology checks the accuracy of the translations done by Machine Translation Tools. It is extremely important because while developing the translation systems, it constantly checks the performance and helps us to make appropriate changes in the system for bringing accuracy. Mostly it is done by comparing the output of machine translation systems with the translation(s) done by Human beings, there are also some techniques that do not require any reference sentences. In our project, we are using four Automated Machine Translation Evaluation metrics which are TER (Translation Error Rate), METEOR (Metric for Evaluation of Translation with Explicit Ordering), BLEU (Bilingual Evaluation Understudy), and NIST (National Institution of Standards and Technology) for English-Hindi Translation.