Video Summarization Using Reinforcement Learning in Eigenspace

In this paper, we propose video summarization using reinforcement learning. The importance score of each frame in a video is calculated from the user's actions in handling similar previous frames; if such frames were watched rather than skipped, a high score is assigned. To calculate the score, instead of using raw feature vectors extracted from images, we use feature vectors projected on eigenspace; as a result, we can deal with the features comprehensively. We also give an algorithm that uses the reinforcement learning method to create a personalized video summary, The summarization algorithm is applied to a soccer video to confirm its effectiveness.

By: Ken Masumitsu, Echigo Tomio

Published in: 2000 IEEE International Conference on Image Processing, Canada, IEEE, vol.2, p.267-270 in 2000

Please obtain a copy of this paper from your local library. IBM cannot distribute this paper externally.

Questions about this service can be mailed to reports@us.ibm.com .