Paper: A Semi-Automatic Evaluation Scheme: Automated Nuggetization for Manual Annotation

ACL ID N07-2055
Title A Semi-Automatic Evaluation Scheme: Automated Nuggetization for Manual Annotation
Venue Human Language Technologies
Session Short Paper
Year 2007
Authors

In this paper we describe automatic in- formation nuggetization and its applica- tion to text comparison. More specifically, we take a close look at how machine-generated nuggets can be used to create evaluation material. A semi- automatic annotation scheme is designed to produce gold-standard data with excep- tionally high inter-human agreement.