Paper: ParaMetric: An Automatic Evaluation Metric for Paraphrasing

ACL ID C08-1013
Title ParaMetric: An Automatic Evaluation Metric for Paraphrasing
Venue International Conference on Computational Linguistics
Session Main Conference
Year 2008
Authors

We present ParaMetric, an automatic eval- uationmetricfordata-drivenapproachesto paraphrasing. ParaMetric provides an ob- jective measure of quality using a collec- tion of multiple translations whose para- phrases have been manually annotated. ParaMetric calculates precision and recall scores by comparing the paraphrases dis- covered by automatic paraphrasing tech- niques against gold standard alignments of words and phrases within equivalent sen- tences. We report scores for several estab- lished paraphrasing techniques.