Paper: Automatic Evaluation of Translation Quality for Distant Language Pairs

ACL ID D10-1092
Title Automatic Evaluation of Translation Quality for Distant Language Pairs
Venue Conference on Empirical Methods in Natural Language Processing
Session Main Conference
Year 2010
Authors

Automatic evaluation of Machine Translation (MT) quality is essential to developing high- quality MT systems. Various evaluation met- rics have been proposed, and BLEU is now used as the de facto standard metric. How- ever, when we consider translation between distant language pairs such as Japanese and English, most popular metrics (e.g., BLEU, NIST, PER, and TER) do not work well. It is well known that Japanese and English have completely different word orders, and special care must be paid to word order in transla- tion. Otherwise, translations with wrong word order often lead to misunderstanding and in- comprehensibility. For instance, SMT-based Japanese-to-English translators tend to trans- late ‘A because B’ as ‘B because A.’ Thus, word order is the most important problem for...