Paper: Is this a wampimuk? Cross-modal mapping between distributional semantics and the visual world

ACL ID P14-1132
Title Is this a wampimuk? Cross-modal mapping between distributional semantics and the visual world
Venue Annual Meeting of the Association of Computational Linguistics
Session Main Conference
Year 2014
Authors

Following up on recent work on estab- lishing a mapping between vector-based semantic embeddings of words and the visual representations of the correspond- ing objects from natural images, we first present a simple approach to cross-modal vector-based semantics for the task of zero-shot learning, in which an image of a previously unseen object is mapped to a linguistic representation denoting its word. We then introduce fast mapping, a challenging and more cognitively plausi- ble variant of the zero-shot task, in which the learner is exposed to new objects and the corresponding words in very limited linguistic contexts. By combining prior linguistic and visual knowledge acquired about words and their objects, as well as exploiting the limited new evidence avail- able, the learner must lear...