TY - JOUR
T1 - A video abstraction method based on viewer's heart activity and its evaluations
AU - Toyosawa, Satoshi
AU - Kawai, Takashi
N1 - Copyright:
Copyright 2017 Elsevier B.V., All rights reserved.
PY - 2009/1
Y1 - 2009/1
N2 - In video abstraction, viewer's emotional reactions to original video play an important role because people often choose what to watch based on the emotional context. We have devised a method for incorporating viewer's perceived impressions in video abstraction. The impression level is measured by the degree of arousal, based on two measures of heart activity: deceleration of heart rate and activation of the higher frequency component of the heart rate variability. For an evaluation of our method, we performed two sets of experiments comparing the abstracts generated by our method against subjective selections. Three short videos with different arousal levels (two arousing and one calm) were used. In Experiment 1, shot matching between two abstracts was examined: the arousing videos showed a 50% match, while the calm one showed a 30% match. In Experiment 2, the abstracts were displayed to the subjects, which they evaluated subjectively: our method generated good results in the arousing/pleasant video.
AB - In video abstraction, viewer's emotional reactions to original video play an important role because people often choose what to watch based on the emotional context. We have devised a method for incorporating viewer's perceived impressions in video abstraction. The impression level is measured by the degree of arousal, based on two measures of heart activity: deceleration of heart rate and activation of the higher frequency component of the heart rate variability. For an evaluation of our method, we performed two sets of experiments comparing the abstracts generated by our method against subjective selections. Three short videos with different arousal levels (two arousing and one calm) were used. In Experiment 1, shot matching between two abstracts was examined: the arousing videos showed a 50% match, while the calm one showed a 30% match. In Experiment 2, the abstracts were displayed to the subjects, which they evaluated subjectively: our method generated good results in the arousing/pleasant video.
UR - http://www.scopus.com/inward/record.url?scp=62349098018&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=62349098018&partnerID=8YFLogxK
U2 - 10.3169/itej.63.86
DO - 10.3169/itej.63.86
M3 - Article
AN - SCOPUS:62349098018
SN - 1342-6907
VL - 63
SP - 86
EP - 94
JO - Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers
JF - Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers
IS - 1
ER -