Paper: Utilizing Extra-Sentential Context for Parsing

ACL ID D10-1003
Title Utilizing Extra-Sentential Context for Parsing
Venue Conference on Empirical Methods in Natural Language Processing
Session Main Conference
Year 2010

Syntactic consistency is the preference to reuse a syntactic construction shortly after its appearance in a discourse. We present an anal- ysis of the WSJ portion of the Penn Tree- bank, and show that syntactic consistency is pervasive across productions with various left- hand side nonterminals. Then, we implement a reranking constituent parser that makes use of extra-sentential context in its feature set. Using a linear-chain conditional random field, we improve parsing accuracy over the gen- erative baseline parser on the Penn Treebank WSJ corpus, rivalling a similar model that does not make use of context. We show that the context-aware and the context-ignorant rerankers perform well on different subsets of the evaluation data, suggesting a combined ap- proach would provide further imp...