Paper: Word Association and MI-Trigger-based Language Modeling

ACL ID C98-2234
Title Word Association and MI-Trigger-based Language Modeling
Venue International Conference on Computational Linguistics
Session Main Conference
Year 1998
Authors

There exists strong word association in natural language. Based on mutual information, this paper proposes a new MI-Trigger-based modeling approach to capture the preferred relationships between words over a short or long distance. Both the distance-independent(DI) and distance- dependent(DD) MI-Trigger-based models are constructed within a window. It is found that proper MI-Trigger modeling is superior to word bigram model and the DD MI-Trigger models have better pertbrmance than the DI MI-Trigger models for the same window size. It is also found that the number of the trigger pairs in an MI- Trigger model can be kept to a reasonable size without losing too much of its modeling power. Finally, it is concluded that the preferred relationships between words are useful to l...