Sentiment analysis of color attributes derived from vowel sound impression for multimodal expression

Kanako Watanabe, Yoko Greenberg, Yoshinori Sagisaka

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)

Abstract

In this paper, the sentiment correlation between color and speech has been investigated aiming at multimodal expression of information embedded in speech. To cope with the necessity of information specification for further analyses and control of speech so called para-linguistic information, we carried out an sentiment experiment on the correlations between speech characteristics and color attributes associated by perceptual impressions. Using five vowel categories with twelve different prosodie patterns, we found high correlations between speech features (vowel categories and FO) and three attributes of color (hue, saturation and value). These correlations open up wide possibilities to describe and quantitatively analyze speech information that has not yet been systematically studied but partially treated as emotional variants or para-linguistic information.

Original languageEnglish
Title of host publication2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9786163618238
DOIs
Publication statusPublished - 2014 Feb 12
Externally publishedYes
Event2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014 - Chiang Mai, Thailand
Duration: 2014 Dec 92014 Dec 12

Publication series

Name2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014

Other

Other2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014
Country/TerritoryThailand
CityChiang Mai
Period14/12/914/12/12

ASJC Scopus subject areas

  • Signal Processing
  • Information Systems

Fingerprint

Dive into the research topics of 'Sentiment analysis of color attributes derived from vowel sound impression for multimodal expression'. Together they form a unique fingerprint.

Cite this