Paper: Combining Deictic Gestures And Natural Language For Referent Identification

ACL ID C86-1085
Title Combining Deictic Gestures And Natural Language For Referent Identification
Venue International Conference on Computational Linguistics
Session Main Conference
Year 1986
Authors

In virtually all current natural-language dialog systems, users can only refer to objects by using linguistic descriptions. How- ever, in human face-to-face conversation, participants fre= quently use various sorts of deictic gestures as well. In this paper, we will present the referent identification component of XTRA, a system for a natural-language access to expert sys- tems. XTRA allows the user to combine NL input together with pointing gestures on the terminal screen in order Io refer to objects on the display. Information about the location and type of this deietic gesture, as well as about the linguistic de- scription of the referred object, the case frame, and the dialog memory are utilized for identifying the object. The system is tolerant in respect to impreciseness of both the ...