Automatic Scene Extraction in Motion Pictures

Copyright © (2003) by IEEE. Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distrubuted for profit. To copy otherwise, to republish, to post on servers, or to redistribute to lists, requires prior specific permission and/or a fee.

This paper addresses the challenge of bridging the semantic gap between the rich meaning users desire when they query to locate and browse media and the shallowness of media descriptions that can be computed in today’s content management systems. To facilitate high-level semantics-based content annotation and interpretation, we tackle the problem of automatic decomposition of motion pictures into meaningful story units, namely scenes. Since a scene is a complicated and subjective concept, we first propose guidelines from film production to determine when a scene change occurs. We then investigate different rules and conventions followed as part of Film Grammar that would guide and shape an algorithmic solution for determining a scene. Two different techniques using intershot
analysis are proposed as solutions in this paper. Further, we present different refinement mechanisms such as film punctuation detection founded on film grammar to further improve the results. In addition, the refinement techniques demonstrate significant improvements in overall performance.

By: Ba Tu Truong , Svetha Venkatesh , Chitra Dorai

Published in: IEEE Transactions on Circuits and Systems for Video Technology, volume 13, (no 1), pages 5-15 in 2003

LIMITED DISTRIBUTION NOTICE:

This Research Report is available. This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and specific requests. After outside publication, requests should be filled only by reprints or legally obtained copies of the article (e.g., payment of royalties). I have read and understand this notice and am a member of the scientific community outside or inside of IBM seeking a single copy only.

RC22569.pdf

Questions about this service can be mailed to reports@us.ibm.com .