Lyric-based automatic music image generator for music browser using scene knowledge

Hiroyuki Kasai*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)


This paper presents a proposal of a music image generator for users to grasp music easily and instantaneously on consumer electronics devices such as music players and smartphones. It provides users faster and more efficient music browsing functionality using a technique that automatically generates a music image that matches lyric contents. More specifically, a scene theme such as an event or place is extracted from lyrics using text mining techniques. A suitable music image is then created dynamically to match this extracted scene theme. This image generation is achieved by synthesizing multiple image materials to express the extracted scene theme flexibly. For choosing image materials, scene knowledge that has representative scene object compositions is proposed. Using this knowledge, the image synthesizer can select appropriate materials. Finally, the performance of the proposed automatic knowledge creation method is evaluated by comparison with manually created knowledge. Based on optimal parameters calculated in the evaluation, some examples of music images for well-known music lyrics are presented. In addition, the implemented system applying the proposed generator onto a server-side and a consumer-side consumer electronics device is also described

Original languageEnglish
Article number6626241
Pages (from-to)578-586
Number of pages9
JournalIEEE Transactions on Consumer Electronics
Issue number3
Publication statusPublished - 2013
Externally publishedYes


  • Lyric analysis
  • Music image generator
  • Scene object composition
  • Sceneknowledge

ASJC Scopus subject areas

  • Media Technology
  • Electrical and Electronic Engineering


Dive into the research topics of 'Lyric-based automatic music image generator for music browser using scene knowledge'. Together they form a unique fingerprint.

Cite this