Paper: Speech Dialogue With Facial Displays: Multimodal Human-Computer Conversation

ACL ID P94-1015
Title Speech Dialogue With Facial Displays: Multimodal Human-Computer Conversation
Venue Annual Meeting of the Association of Computational Linguistics
Session Main Conference
Year 1994
Authors

Human face-to-face conversation is an ideal model for human-computer dialogue. One of the major features of face-to-face communication is its multi- plicity of communication channels that act on mul- tiple modalities. To realize a natural multimodal dialogue, it is necessary to study how humans per- ceive information and determine the information to which humans are sensitive. A face is an in- dependent communication channel that conveys emotional and conversational signals, encoded as facial expressions. We have developed an experi- mental system that integrates speech dialogue and facial animation, to investigate the effect of intro- ducing communicative facial expressions as a new modality in human-computer conversation. Our experiments have showen that facial expressions are helpful, e...