Paper: Multi-Site Data Collection And Evaluation In Spoken Language Understanding

ACL ID H93-1004
Title Multi-Site Data Collection And Evaluation In Spoken Language Understanding
Venue Human Language Technologies
Session Main Conference
Year 1993
Authors

The Air Travel Information System (ATIS) domain serves as the common task for DARPA spoken language system re- search and development. The approaches and results possi- ble in this rapidly growing area are structured by available corpora, annotations of that data, and evaluation methods. Coordination of this crucial infrastructure is the charter of the Multi-Site ATIS Data COllection Working group (MAD- COW). We focus here on selection of training and test data, evaluation of language understanding, and the continuing search for evaluation methods that will correlate well with expected performance of the technology in applications.