Inspiring Viewers of Abstract Painting by a Gaze Based Music Generation

Tatsuya Ogusu, Jun Ohya, Jun Kurumisawa, Shunichi Yonemura

Research output: Chapter in Book/Report/Conference proceedingConference contribution


This paper explores the effectiveness of prompting abstract paintings' viewers' inspiration and imagination by the authors' gaze based music generation system. The authors' music generation system detects the viewer's gaze by a gaze detection equipment. At each of the gaze staying positions in the painting, the color of that point is converted to the sound so that as the gaze moves, music that consists of the converted time series sounds is generated. Experiments using six subjects and six abstract paintings were conducted for the three cases in which the subjects see the abstract paintings without hearing any music, while hearing pre-selected music and while hearing the viewers' gaze based music generated by the authors' system. The experimental results imply that "hearing gaze based music" could stimulate the viewers' inspiration and imagination best, "hearing pre-selected music" second best, and "without music" third best.

Original languageEnglish
Title of host publicationHCI International 2014 - Posters' Extended Abstracts - International Conference, HCI International 2014, Proceedings
PublisherSpringer Verlag
Number of pages5
ISBN (Print)9783319078564
Publication statusPublished - 2014 Jan 1

Publication series

NameCommunications in Computer and Information Science
Volume434 PART I
ISSN (Print)1865-0929


  • Abstract Painting
  • Gaze Behavior
  • Inspiration
  • Music

ASJC Scopus subject areas

  • Computer Science(all)
  • Mathematics(all)


Dive into the research topics of 'Inspiring Viewers of Abstract Painting by a Gaze Based Music Generation'. Together they form a unique fingerprint.

Cite this