Paper: The TUNA Challenge 2008: Overview and Evaluation Results

ACL ID W08-1131
Title The TUNA Challenge 2008: Overview and Evaluation Results
Venue International Conference on Natural Language Generation
Session Main Conference
Year 2008
Authors

The TUNA Challenge was a set of three shared tasks at REG’08, all of which used data from the TUNA Corpus. The three tasks covered attribute selection for referring expressions (TUNA-AS), realisation (TUNA-R) and end-toend referring expression generation (TUNAREG). 8 teams submitted a total of 33 systems to the three tasks, with an additional submission to the Open Track. The evaluation used a range of automatically computed measures. In addition, an evaluation experiment was carried out using the peer outputs for the TUNAREG task. This report describes each task and the evaluation methods used, and presents the evaluation results.