A video abstraction method based on viewer's heart activity and its evaluations

Satoshi Toyosawa*, Takashi Kawai

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)


In video abstraction, viewer's emotional reactions to original video play an important role because people often choose what to watch based on the emotional context. We have devised a method for incorporating viewer's perceived impressions in video abstraction. The impression level is measured by the degree of arousal, based on two measures of heart activity: deceleration of heart rate and activation of the higher frequency component of the heart rate variability. For an evaluation of our method, we performed two sets of experiments comparing the abstracts generated by our method against subjective selections. Three short videos with different arousal levels (two arousing and one calm) were used. In Experiment 1, shot matching between two abstracts was examined: the arousing videos showed a 50% match, while the calm one showed a 30% match. In Experiment 2, the abstracts were displayed to the subjects, which they evaluated subjectively: our method generated good results in the arousing/pleasant video.

Original languageEnglish
Pages (from-to)86-94
Number of pages9
JournalKyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers
Issue number1
Publication statusPublished - 2009 Jan

ASJC Scopus subject areas

  • Media Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering


Dive into the research topics of 'A video abstraction method based on viewer's heart activity and its evaluations'. Together they form a unique fingerprint.

Cite this