Paper: An Integrated Dialog Simulation Technique for Evaluating Spoken Dialog Systems

ACL ID W08-1503
Title An Integrated Dialog Simulation Technique for Evaluating Spoken Dialog Systems
Venue Workshop on Cognitive Aspects of the Lexicon
Session
Year 2008
Authors

This paper proposes a novel integrated dialog simulation technique for evaluating spoken di- alog systems. Many techniques for simulat- ing users and errors have been proposed for use in improving and evaluating spoken dia- log systems, but most of them are not easily applied to various dialog systems or domains because some are limited to specific domains or others require heuristic rules. In this pa- per, we propose a highly-portable technique for simulating user intention, utterance and Au- tomatic Speech Recognition (ASR) channels. This technique can be used to rapidly build a dialog simulation system for evaluating spo- ken dialog systems. We propose a novel user intention modeling and generating method that uses a linear-chain conditional random field, a data-driven domain specific u...