Paper: Measures And Models For Phrase Recognition

ACL ID H93-1046
Title Measures And Models For Phrase Recognition
Venue Human Language Technologies
Session Main Conference
Year 1993

I present an entropy measure for evaluating parser performance. The measure is fine-grained, and permits us to evaluate performance at the level of individual phrases. The parsing problem is characterized as statistically approximating the Penn Treebank annotations. I consider a series of models to "calibrate" the measure by determining what scores can be achieved using the most obvious kinds of information. I also relate the entropy measure to measures of recall/precision and grammar coverage.