Paper: Performance Evaluation And Error Analysis For Multimodal Reference Resolution In A Conversation System

ACL ID N04-4011
Title Performance Evaluation And Error Analysis For Multimodal Reference Resolution In A Conversation System
Venue Human Language Technologies
Session Short Paper
Year 2004
Authors

Multimodal reference resolution is a process that automatically identifies what users refer to during multimodal human-machine conversation. Given the substantial work on multimodal reference resolution; it is important to evaluate the current state of the art, understand the limitations, and identify directions for future improvement. We conducted a series of user studies to evaluate the capability of reference resolution in a multimodal conversation system. This paper analyzes the main error sources during real-time human-machine interaction and presents key strategies for designing robust multimodal reference resolution algorithms.