Paper: Paraphrasing For Automatic Evaluation

ACL ID N06-1058
Title Paraphrasing For Automatic Evaluation
Venue Human Language Technologies
Session Main Conference
Year 2006

This paper studies the impact of para- phrases on the accuracy of automatic eval- uation. Given a reference sentence and a machine-generated sentence, we seek to nd a paraphrase of the reference sen- tence that is closer in wording to the ma- chine output than the original reference. We apply our paraphrasing method in the context of machine translation evaluation. Our experiments show that the use of a paraphrased synthetic reference re nes the accuracy of automatic evaluation. We also found a strong connection between the quality of automatic paraphrases as judged by humans and their contribution to automatic evaluation.