Spotting by Association in News Video

Yuichi Nakamura and Takeo Kanade

Conference Paper, Proceedings of AAAI '97 Spring Symposium on Intelligent Integration and Use of Text, Image, Video, and Audio Corpora, pp. 113 - 119, March, 1997

View Publication

Abstract

This paper introduces the Spotting by Association method for video analysis, which is a novel method to detect video segments with typical semantics. Video data contains various kinds of information by means of continuous images, natural language, and sound. For use in a Digital Library, it is essential to segment the video data into meaningful pieces. To detect meaningful segments, we should associate data from each modality, including video, language, and sound. For this purpose, we propose a new method for segment spotting by making correspondences between image clues detected by image analysis and language clues created by natural language analysis. As a result, relevant video segments with sufficient information in every modMity are obtained. We applied our method to closed-captioned CNN Headline News. Video segments with important situations, that is a speech, meeting, or visit, are detected fairly well.

BibTeX

@conference{Nakamura-1997-14319,
author = {Yuichi Nakamura and Takeo Kanade},
title = {Spotting by Association in News Video},
booktitle = {Proceedings of AAAI '97 Spring Symposium on Intelligent Integration and Use of Text, Image, Video, and Audio Corpora},
year = {1997},
month = {March},
pages = {113 - 119},
}

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.