Paper: Annotation-Based Multimedia Summarization And Translation

ACL ID C02-1098
Title Annotation-Based Multimedia Summarization And Translation
Venue International Conference on Computational Linguistics
Session Main Conference
Year 2002

This paper presents techniques for multimedia annotation and their application to video sum- marization and translation. Our tool for anno- tation allows users to easily create annotation including voice transcripts, video scene descrip- tions, and visual/auditory object descriptions. The module for voice transcription is capable of multilingual spoken language identification and recognition. A video scene description con- sists of semi-automatically detected keyframes of each scene in a video clip and time codes of scenes. A visual object description is created by tracking and interactive naming of people and objects in video scenes. The text data in themultimediaannotationaresyntacticallyand semantically structuredusing linguistic annota- tion. The proposed multimedia summarization work...