Paper: Probabilistic Tree-Adjoining Grammar As A Framework For Statistical Natural Language Processing

ACL ID C92-2065
Title Probabilistic Tree-Adjoining Grammar As A Framework For Statistical Natural Language Processing
Venue International Conference on Computational Linguistics
Session Main Conference
Year 1992
Authors

In this paper, I argue for the use of a probabilistic form of tree-adjoining grammar (TAG) in statistical natural language processing. I first discuss two previ- ous statistical approaches --- one that concentrates on the probabilities of structural operations, and another that emphasizes co, occurrence relationships between words. I argue that a purely structural approach, ex- emplified by probabilistie context-free grammar, lacks sufficient sensitivity to lexical context, and, conversely, that lexical co-occurence analyses require a richer no- tion of locality that is best provided by importing some notion of structure. I then propose probabilistie TAG as a framework for statistical language modelling, arguing that it pro- vides an advantageous combination of structure, local- ity, and l...