Paper: A Three-Tiered Evaluation Approach For Interactive Spoken Dialogue Systems

ACL ID H01-1068
Title A Three-Tiered Evaluation Approach For Interactive Spoken Dialogue Systems
Venue Human Language Technologies
Session Main Conference
Year 2001
Authors

We describe a three-tiered approach for evaluation of spoken dialogue systems. The three tiers measure user satisfaction, system support of mission success and component performance. We describe our use of this approach in numerous fielded user studies conducted with the U.S. military. Keywords Evaluation, spoken language system, spoken dialogue system 1.