Paper: A New Syntactic Metric for Evaluation of Machine Translation

ACL ID P13-3019
Title A New Syntactic Metric for Evaluation of Machine Translation
Venue Annual Meeting of the Association of Computational Linguistics
Session Student Session
Year 2013
Authors

Machine translation (MT) evaluation aims at measuring the quality of a candidate translation by comparing it with a reference translation. This comparison can be performed on multiple levels: lexical, syntactic or semantic. In this paper, we propose a new syntactic metric for MT evaluation based on the comparison of the dependency structures of the reference and the candidate translations. The dependency structures are obtained by means of a Weighted Constraints Dependency Grammar parser. Based on experiments performed on English to German translations, we show that the new metric correlates well with human judgments at the system level.