Paper: AM-FM: A Semantic Framework for Translation Quality Assessment

ACL ID P11-2027
Title AM-FM: A Semantic Framework for Translation Quality Assessment
Venue Annual Meeting of the Association of Computational Linguistics
Session Main Conference
Year 2011
Authors

This work introduces AM-FM, a semantic framework for machine translation evalua- tion. Based upon this framework, a new evaluation metric, which is able to operate without the need for reference translations, is implemented and evaluated. The metric is based on the concepts of adequacy and fluency, which are independently assessed by using a cross-language latent semantic indexing approach and an n-gram based language model approach, respectively. Comparative analyses with conventional evaluation metrics are conducted on two different evaluation tasks (overall quality assessment and comparative ranking) over a large collection of human evaluations in- volving five European languages. Finally, the main pros and cons of the proposed framework are discussed along with future ...