Affect Computing in Film through Sound Energy Dynamics

We develop an algorithm for the detection and classification of affective sound events underscored by specific patterns of sound energy dynamics. We relate the portrayal of these events to proposed high level affect or emotional coloring of the events. In this paper, four possible characteristic sound energy events are identified that convey well established meanings through their dynamics to partray and deliver certain affect, sentiment related to the horror film genre. Our algorithm is developed with the ultimate aim of auto-ox& ally strocruring sections of films that contain distinct shades of emotion related to horror themes for nonlinear media access and navigation. An average of 82% of the energy events, obtained from the analysis of the audio tracks of sections of four sample films corresponded correctly to the proposed affect. While the discrimination between certain sound energy event types was low, the algorithm correctly detected 71% of the occurences of the sound energy events within audio tracks of the films analyzed, and thus forms a useful basis for determining affective scenes characteristic

By: Simon Moncrief(Curtin University of Technology) , Chitra Dorai, Svetha Venkatesh(Curtin University of Technology)

Published in: RC22126 in 2001

LIMITED DISTRIBUTION NOTICE:

This Research Report is available. This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and specific requests. After outside publication, requests should be filled only by reprints or legally obtained copies of the article (e.g., payment of royalties). I have read and understand this notice and am a member of the scientific community outside or inside of IBM seeking a single copy only.

RC22126.pdf

Questions about this service can be mailed to reports@us.ibm.com .