Paper: Evaluating Automatic Dialogue Strategy Adaptation For A Spoken Dialogue System

ACL ID A00-2027
Title Evaluating Automatic Dialogue Strategy Adaptation For A Spoken Dialogue System
Venue Annual Conference of the North American Chapter of the Association for Computational Linguistics
Session Main Conference
Year 2000
Authors

In this paper, we describe an empirical evaluation of an adaptive mixed initiative spoken dialogue system. We conducted two sets of experiments to evaluate the mixed initiative and automatic adaptation aspects of the system, and analyzed the resulting dialogues along three dimen- sions: performance factors, discourse features, and ini- tiative distribution. Our results show that 1) both the mixed initiative and automatic adaptation aspects led to better system performance in terms of user satisfac- tion and dialogue efficiency, and 2) the system's adap- tation behavior better matched user expectations, more efficiently resolved dialogue anomalies, and resulted in higher overall dialogue quality.