Paper: Exploring Asymmetric Clustering For Statistical Language Modeling

ACL ID P02-1024
Title Exploring Asymmetric Clustering For Statistical Language Modeling
Venue Annual Meeting of the Association of Computational Linguistics
Session Main Conference
Year 2002
Authors

The n-gram model is a stochastic model, which predicts the next word (predicted word) given the previous words (conditional words) in a word sequence. The cluster n-gram model is a variant of the n-gram model in which similar words are classified in the same cluster. It has been demonstrated that using different clusters for predicted and conditional words leads to cluster models that are superior to classical cluster models which use the same clusters for both words. This is the basis of the asymmetric cluster model (ACM) discussed in our study. In this paper, we first present a formal definition of the ACM. We then describe in detail the methodology of constructing the ACM. The effectiveness of the ACM is evaluated on a realistic application, namely Japanese Kana-Kanji conversion. Experi...