Paper: Taking Account Of The User's View In 3D Multimodal Instruction Dialogue

ACL ID C00-1083
Title Taking Account Of The User's View In 3D Multimodal Instruction Dialogue
Venue International Conference on Computational Linguistics
Session Main Conference
Year 2000
Authors

While recent advancements in virtual reality technology have created a rich communication interface linking hu- mans and computers, there has beefl little work on build- ing dialogue systems for 3D virtual worlds. This paper proposes a method for altering the instruction dialogue to match the user's view in a virtual enviromnent. -~re illustrate the method with the system MID-aD, which in- teractively instructs the user on dismantling some parts of a car. First, in order to change the content of ~he instruction dialogue to match the user's view, we extend the refinement-driven plmming algorithm by using the user's view as a l)lan constraint. Second, to manage the dialogue smoothly, the systeln keeps track of the user's viewpoint as part of the dialogue skate and uses this information for c...