Paper: Nonlocal Language Modeling Based On Context Co-Occurrence Vectors

ACL ID W00-1310
Title Nonlocal Language Modeling Based On Context Co-Occurrence Vectors
Venue 2000 Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora
Session Main Conference
Year 2000
Authors

This paper presents a novel nonlocal lmlguage model which utilizes contextual information. A reduced vector space model calculated from co-occurrences of word pairs provides word co-occurrence vectors. The sum of word co- occurrence vectors represents tile context of a document, and the cosine similarity between the context vector and the word co-occurrence vectors represents the ]ong-distmlce lexical de- pendencies.