Paper: Distributional Clustering Of English Words

ACL ID P93-1024
Title Distributional Clustering Of English Words
Venue Annual Meeting of the Association of Computational Linguistics
Session Main Conference
Year 1993

We describe and evaluate experimentally a method for clustering words according to their dis- tribution in particular syntactic contexts. Words are represented by the relative frequency distribu- tions of contexts in which they appear, and rela- tive entropy between those distributions is used as the similarity measure for clustering. Clusters are represented by average context distributions de- rived from the given words according to their prob- abilities of cluster membership. In many cases, the clusters can be thought of as encoding coarse sense distinctions. Deterministic annealing is used to find lowest distortion sets of clusters: as the an- nealing parameter increases, existing clusters be- come unstable and subdivide, yielding a hierarchi- cal "soft" clustering of the data. Cluster...