A soundtrack generation system to synchronize the climax of a video clip with music

Haruki Sato, Tatsunori Hirai, Tomoyasu Nakano, Masataka Goto, Shigeo Morishima

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

In this paper, we present a soundtrack generation system that can automatically add a soundtrack with the length and climax points aligned to those of a video clip. Adding a soundtrack to a video clip is an important process in video editing. Editors tend to add chorus sections to the climax points of the video clip by replacing and concatenating musical segments. However, this process is time-consuming. Our system automatically detects climaxes of both the video clips and music based on feature extraction and analysis. This enables the system to add a soundtrack in which the climax is synchronized to the climax of the video clip. We evaluated the generated soundtracks through a subjective evaluation.

Original languageEnglish
Title of host publication2016 IEEE International Conference on Multimedia and Expo, ICME 2016
PublisherIEEE Computer Society
ISBN (Electronic)9781467372589
DOIs
Publication statusPublished - 2016 Aug 25
Event2016 IEEE International Conference on Multimedia and Expo, ICME 2016 - Seattle, United States
Duration: 2016 Jul 112016 Jul 15

Publication series

NameProceedings - IEEE International Conference on Multimedia and Expo
Volume2016-August
ISSN (Print)1945-7871
ISSN (Electronic)1945-788X

Other

Other2016 IEEE International Conference on Multimedia and Expo, ICME 2016
Country/TerritoryUnited States
CitySeattle
Period16/7/1116/7/15

Keywords

  • audio-visual feature extraction
  • climax synchronization
  • soundtrack generation

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'A soundtrack generation system to synchronize the climax of a video clip with music'. Together they form a unique fingerprint.

Cite this