Paper: Evaluating Centering-Based Metrics Of Coherence For Text Structuring Using A Reliably Annotated Corpus

ACL ID P04-1050
Title Evaluating Centering-Based Metrics Of Coherence For Text Structuring Using A Reliably Annotated Corpus
Venue Annual Meeting of the Association of Computational Linguistics
Session Main Conference
Year 2004
Authors

We use a reliably annotated corpus to compare metrics of coherence based on Centering The- ory with respect to their potential usefulness for text structuring in natural language generation. Previous corpus-based evaluations of the coher- ence of text according to Centering did not com- pare the coherence of the chosen text structure with that of the possible alternatives. A corpus- based methodology is presented which distin- guishes between Centering-based metrics taking these alternatives into account, and represents therefore a more appropriate way to evaluate Centering from a text structuring perspective. 1 Motivation Our research area is descriptive text generation (O’Donnell et al. , 2001; Isard et al. , 2003), i.e. the generation of descriptions of objects, typi- cally museum art...