Paper: Word Association and MI Trigger-based Language Modeling

ACL ID P98-2239
Title Word Association and MI Trigger-based Language Modeling
Venue Annual Meeting of the Association of Computational Linguistics
Session Main Conference
Year 1998
Authors

There exists strong word association in natural language. Based on mutual information, this paper proposes a new MI-Trigger-based modeling approach to capture the preferred relationships between words over a short or long distance. Both the distance-independent(DI) and distance- dependent(DD) MI-Trigger-based models are constructed within a window. It is found that proper MI-Trigger modeling is superior to word bigram model and the DD MI-Trigger models have better performance than the DI MI-Trigger models for the same window size. It is also found that the number of the trigger pairs in an MI- Trigger model can be kept to a reasonable size without losing too much of its modeling power. Finally, it is concluded that the preferred relationships between words are useful to language disambigua...