Paper: SemEval-2014 Task 2: Grammar Induction for Spoken Dialogue Systems

ACL ID S14-2002
Title SemEval-2014 Task 2: Grammar Induction for Spoken Dialogue Systems
Venue Joint Conference on Lexical and Computational Semantics
Session
Year 2014
Authors

In this paper we present the SemEval- 2014 Task 2 on spoken dialogue gram- mar induction. The task is to classify a lexical fragment to the appropriate se- mantic category (grammar rule) in order to construct a grammar for spoken dia- logue systems. We describe four sub- tasks covering two languages, English and Greek, and three speech application do- mains, travel reservation, tourism and fi- nance. The classification results are com- pared against the groundtruth. Weighted and unweighted precision, recall and f- measure are reported. Three sites partic- ipated in the task with five systems, em- ploying a variety of features and in some cases using external resources for training. The submissions manage to significantly beat the baseline, achieving a f-measure of 0.69 in comparison to 0.5...