Paper: Building A Semantically Transparent Corpus For The Generation Of Referring Expressions

ACL ID W06-1420
Title Building A Semantically Transparent Corpus For The Generation Of Referring Expressions
Venue International Conference on Natural Language Generation
Session Main Conference
Year 2006
Authors

This paper discusses the construction of a corpus for the evaluation of algorithms that generate referring expressions. It is argued that such an evaluation task re- quires a semantically transparent corpus, and controlled experiments are the best way to create such a resource. We address a number of issues that have arisen in an ongoing evaluation study, among which is the problem of judging the output of GRE algorithms against a human gold standard. 1 Creating and using a corpus for GRE A decade ago, Dale and Reiter (1995) published a seminal paper in which they compared a num- ber of GRE algorithms. These algorithms included a Full Brevity (FB) algorithm which generates de- scriptions of minimal length, a greedy algorithm (GA), and an Incremental Algorithm (IA). The authors argued that ...