Paper: Joint Evaluation of Morphological Segmentation and Syntactic Parsing

ACL ID P12-2002
Title Joint Evaluation of Morphological Segmentation and Syntactic Parsing
Venue Annual Meeting of the Association of Computational Linguistics
Session Short Paper
Year 2012
Authors

We present novel metrics for parse evalua- tion in joint segmentation and parsing sce- narios where the gold sequence of terminals is not known in advance. The protocol uses distance-based metrics defined for the space of trees over lattices. Our metrics allow us to precisely quantify the performance gap be- tween non-realistic parsing scenarios (assum- ing gold segmented and tagged input) and re- alistic ones (not assuming gold segmentation and tags). Our evaluation of segmentation and parsing for Modern Hebrew sheds new light on the performance of the best parsing systems to date in the different scenarios.