Paper: Automatic Evaluation of Machine Translation Based on Rate of Accomplishment of Sub-Goals

ACL ID N07-1005
Title Automatic Evaluation of Machine Translation Based on Rate of Accomplishment of Sub-Goals
Venue Human Language Technologies
Session Main Conference
Year 2007
Authors

The quality of a sentence translated by a machine translation (MT) system is dif- ficult to evaluate. We propose a method for automatically evaluating the quality of each translation. In general, when translating a given sentence, one or more conditions should be satisfied to maintain a high translation quality. In English- Japanese translation, for example, prepo- sitions and infinitives must be appropri- ately translated. We show several proce- dures that enable evaluating the quality of a translated sentence more appropriately than using conventional methods. The first procedure is constructing a test set where the conditions are assigned to each test-set sentence in the form of yes/no questions. The second procedure is devel- oping a system that determines an answer to each question. T...