Paper: Resolving Referring Expressions in Conversational Dialogs for Natural User Interfaces

ACL ID D14-1223
Title Resolving Referring Expressions in Conversational Dialogs for Natural User Interfaces
Venue Conference on Empirical Methods in Natural Language Processing
Session Main Conference
Year 2014
Authors

Unlike traditional over-the-phone spoken dialog systems (SDSs), modern dialog systems tend to have visual rendering on the device screen as an additional modal- ity to communicate the system?s response to the user. Visual display of the system?s response not only changes human behav- ior when interacting with devices, but also creates new research areas in SDSs. On- screen item identification and resolution in utterances is one critical problem to achieve a natural and accurate human- machine communication. We pose the problem as a classification task to cor- rectly identify intended on-screen item(s) from user utterances. Using syntactic, se- mantic as well as context features from the display screen, our model can resolve dif- ferent types of referring expressions with up to 90% accuracy...