Paper: Learning to Differentiate Better from Worse Translations

ACL ID D14-1027
Title Learning to Differentiate Better from Worse Translations
Venue Conference on Empirical Methods in Natural Language Processing
Session Main Conference
Year 2014

We present a pairwise learning-to-rank approach to machine translation evalua- tion that learns to differentiate better from worse translations in the context of a given reference. We integrate several layers of linguistic information encapsulated in tree-based structures, making use of both the reference and the system output simul- taneously, thus bringing our ranking closer to how humans evaluate translations. Most importantly, instead of deciding upfront which types of features are important, we use the learning framework of preference re-ranking kernels to learn the features au- tomatically. The evaluation results show that learning in the proposed framework yields better correlation with humans than computing the direct similarity over the same type of structures. Also, we show our s...