Paper: Measuring Lexical Cohesion: Beyond Word Repetition

ACL ID C14-1046
Title Measuring Lexical Cohesion: Beyond Word Repetition
Venue International Conference on Computational Linguistics
Session Main Conference
Year 2014

This paper considers the problem of finding topical shifts in documents and in particular at what information can be leveraged to identify them. Recent research on topical segmentation usually assumes that topical shifts in discourse are signalled by changes in vocabulary. This information, however, is not always a sufficient indicator of a topical shift, especially for certain genres. This paper explores an additional source of information. Our hypothesis is that the type of a referring expression is an indicator of how accessible its antecedent is. The shorter and less informative the expression (e.g., a personal pronoun versus a lengthy post-modified noun phrase), the more accessible the antecedent is likely to be and the more likely it is that the topic under discussion has remained co...