Inspiring Viewers of Abstract Painting by a Gaze Based Music Generation

Tatsuya Ogusu, Jun Ohya, Jun Kurumisawa, Shunichi Yonemura

研究成果: Conference contribution


This paper explores the effectiveness of prompting abstract paintings' viewers' inspiration and imagination by the authors' gaze based music generation system. The authors' music generation system detects the viewer's gaze by a gaze detection equipment. At each of the gaze staying positions in the painting, the color of that point is converted to the sound so that as the gaze moves, music that consists of the converted time series sounds is generated. Experiments using six subjects and six abstract paintings were conducted for the three cases in which the subjects see the abstract paintings without hearing any music, while hearing pre-selected music and while hearing the viewers' gaze based music generated by the authors' system. The experimental results imply that "hearing gaze based music" could stimulate the viewers' inspiration and imagination best, "hearing pre-selected music" second best, and "without music" third best.

ホスト出版物のタイトルHCI International 2014 - Posters' Extended Abstracts - International Conference, HCI International 2014, Proceedings
出版社Springer Verlag
出版ステータスPublished - 2014 1月 1


名前Communications in Computer and Information Science
434 PART I

ASJC Scopus subject areas

  • コンピュータ サイエンス(全般)
  • 数学 (全般)


「Inspiring Viewers of Abstract Painting by a Gaze Based Music Generation」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。