Two-dimensional emotion evaluation with multiple physiological signals

Jyun Rong Zhuang; Ya Jing Guan; Hayato Nagayoshi; Louis Yuge; Hee Hyol Lee; Eiichiro Tanaka

doi:10.1007/978-3-319-94944-4_18

Two-dimensional emotion evaluation with multiple physiological signals

Jyun Rong Zhuang^*, Ya Jing Guan, Hayato Nagayoshi, Louis Yuge, Hee Hyol Lee, Eiichiro Tanaka

^*Corresponding author for this work

Graduate School of Information, Production and Systems

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

16 Citations (Scopus)

Abstract

Extended roles of robots for activities of daily living (ADL) lead to researchers’ increasing attention to human-robot interaction. Emotional recognition has been regarded as an important issue from the human mental aspect. We are developing an assistive walking device which considers the correlation between physical assistance and mental conditions for the user. To connect the assistive device and user mental conditions, it is necessary to evaluate emotion in real-time. This study aims to develop a new method of two-dimensional valence-arousal model emotion evaluation with multiple physiological signals. We elicit users’ emotion change based on normative affective stimuli database, and further extract multiple physiological signals from the subjects. Moreover, we implement various algorithms (k-means, T method of MTS (Mahalanobis Taguchi System) and DNN (deep neural network)) for determining the emotional state from physiological data. Finally, the findings indicate that deep neural network method can precisely recognize the human emotional state.

Original language	English
Title of host publication	Advances in Affective and Pleasurable Design - Proceedings of the AHFE 2018 International Conference on Affective and Pleasurable Design, 2018
Editors	Shuichi Fukuda
Publisher	Springer Verlag
Pages	158-168
Number of pages	11
ISBN (Print)	9783319949437
DOIs	https://doi.org/10.1007/978-3-319-94944-4_18
Publication status	Published - 2019
Event	AHFE International Conference on Affective and Pleasurable Design, 2018 - Orlando, United States Duration: 2018 Jul 21 → 2018 Jul 25

Publication series

Name	Advances in Intelligent Systems and Computing
Volume	774
ISSN (Print)	2194-5357

Conference

Conference	AHFE International Conference on Affective and Pleasurable Design, 2018
Country/Territory	United States
City	Orlando
Period	18/7/21 → 18/7/25

Keywords

Emotion evaluation
Physiological data
Promotion of exercise
Rehabilitation

ASJC Scopus subject areas

Control and Systems Engineering
Computer Science(all)

Access to Document

10.1007/978-3-319-94944-4_18

Cite this

Zhuang, J. R., Guan, Y. J., Nagayoshi, H., Yuge, L., Lee, H. H., & Tanaka, E. (2019). Two-dimensional emotion evaluation with multiple physiological signals. In S. Fukuda (Ed.), Advances in Affective and Pleasurable Design - Proceedings of the AHFE 2018 International Conference on Affective and Pleasurable Design, 2018 (pp. 158-168). (Advances in Intelligent Systems and Computing; Vol. 774). Springer Verlag. https://doi.org/10.1007/978-3-319-94944-4_18

Two-dimensional emotion evaluation with multiple physiological signals. / Zhuang, Jyun Rong; Guan, Ya Jing; Nagayoshi, Hayato et al.
Advances in Affective and Pleasurable Design - Proceedings of the AHFE 2018 International Conference on Affective and Pleasurable Design, 2018. ed. / Shuichi Fukuda. Springer Verlag, 2019. p. 158-168 (Advances in Intelligent Systems and Computing; Vol. 774).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Zhuang, JR, Guan, YJ, Nagayoshi, H, Yuge, L, Lee, HH & Tanaka, E 2019, Two-dimensional emotion evaluation with multiple physiological signals. in S Fukuda (ed.), Advances in Affective and Pleasurable Design - Proceedings of the AHFE 2018 International Conference on Affective and Pleasurable Design, 2018. Advances in Intelligent Systems and Computing, vol. 774, Springer Verlag, pp. 158-168, AHFE International Conference on Affective and Pleasurable Design, 2018, Orlando, United States, 18/7/21. https://doi.org/10.1007/978-3-319-94944-4_18

Zhuang JR, Guan YJ, Nagayoshi H, Yuge L, Lee HH , Tanaka E. Two-dimensional emotion evaluation with multiple physiological signals. In Fukuda S, editor, Advances in Affective and Pleasurable Design - Proceedings of the AHFE 2018 International Conference on Affective and Pleasurable Design, 2018. Springer Verlag. 2019. p. 158-168. (Advances in Intelligent Systems and Computing). doi: 10.1007/978-3-319-94944-4_18

Zhuang, Jyun Rong ; Guan, Ya Jing ; Nagayoshi, Hayato et al. / Two-dimensional emotion evaluation with multiple physiological signals. Advances in Affective and Pleasurable Design - Proceedings of the AHFE 2018 International Conference on Affective and Pleasurable Design, 2018. editor / Shuichi Fukuda. Springer Verlag, 2019. pp. 158-168 (Advances in Intelligent Systems and Computing).

@inproceedings{d65610e5c7a74441974adfe38f9836e7,

title = "Two-dimensional emotion evaluation with multiple physiological signals",

abstract = "Extended roles of robots for activities of daily living (ADL) lead to researchers{\textquoteright} increasing attention to human-robot interaction. Emotional recognition has been regarded as an important issue from the human mental aspect. We are developing an assistive walking device which considers the correlation between physical assistance and mental conditions for the user. To connect the assistive device and user mental conditions, it is necessary to evaluate emotion in real-time. This study aims to develop a new method of two-dimensional valence-arousal model emotion evaluation with multiple physiological signals. We elicit users{\textquoteright} emotion change based on normative affective stimuli database, and further extract multiple physiological signals from the subjects. Moreover, we implement various algorithms (k-means, T method of MTS (Mahalanobis Taguchi System) and DNN (deep neural network)) for determining the emotional state from physiological data. Finally, the findings indicate that deep neural network method can precisely recognize the human emotional state.",

keywords = "Emotion evaluation, Physiological data, Promotion of exercise, Rehabilitation",

author = "Zhuang, {Jyun Rong} and Guan, {Ya Jing} and Hayato Nagayoshi and Louis Yuge and Lee, {Hee Hyol} and Eiichiro Tanaka",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing AG, part of Springer Nature 2019.; AHFE International Conference on Affective and Pleasurable Design, 2018 ; Conference date: 21-07-2018 Through 25-07-2018",

year = "2019",

doi = "10.1007/978-3-319-94944-4_18",

language = "English",

isbn = "9783319949437",

series = "Advances in Intelligent Systems and Computing",

publisher = "Springer Verlag",

pages = "158--168",

editor = "Shuichi Fukuda",

booktitle = "Advances in Affective and Pleasurable Design - Proceedings of the AHFE 2018 International Conference on Affective and Pleasurable Design, 2018",

}

TY - GEN

T1 - Two-dimensional emotion evaluation with multiple physiological signals

AU - Zhuang, Jyun Rong

AU - Guan, Ya Jing

AU - Nagayoshi, Hayato

AU - Yuge, Louis

AU - Lee, Hee Hyol

AU - Tanaka, Eiichiro

N1 - Publisher Copyright: © Springer International Publishing AG, part of Springer Nature 2019.

PY - 2019

Y1 - 2019

N2 - Extended roles of robots for activities of daily living (ADL) lead to researchers’ increasing attention to human-robot interaction. Emotional recognition has been regarded as an important issue from the human mental aspect. We are developing an assistive walking device which considers the correlation between physical assistance and mental conditions for the user. To connect the assistive device and user mental conditions, it is necessary to evaluate emotion in real-time. This study aims to develop a new method of two-dimensional valence-arousal model emotion evaluation with multiple physiological signals. We elicit users’ emotion change based on normative affective stimuli database, and further extract multiple physiological signals from the subjects. Moreover, we implement various algorithms (k-means, T method of MTS (Mahalanobis Taguchi System) and DNN (deep neural network)) for determining the emotional state from physiological data. Finally, the findings indicate that deep neural network method can precisely recognize the human emotional state.

AB - Extended roles of robots for activities of daily living (ADL) lead to researchers’ increasing attention to human-robot interaction. Emotional recognition has been regarded as an important issue from the human mental aspect. We are developing an assistive walking device which considers the correlation between physical assistance and mental conditions for the user. To connect the assistive device and user mental conditions, it is necessary to evaluate emotion in real-time. This study aims to develop a new method of two-dimensional valence-arousal model emotion evaluation with multiple physiological signals. We elicit users’ emotion change based on normative affective stimuli database, and further extract multiple physiological signals from the subjects. Moreover, we implement various algorithms (k-means, T method of MTS (Mahalanobis Taguchi System) and DNN (deep neural network)) for determining the emotional state from physiological data. Finally, the findings indicate that deep neural network method can precisely recognize the human emotional state.

KW - Emotion evaluation

KW - Physiological data

KW - Promotion of exercise

KW - Rehabilitation

UR - http://www.scopus.com/inward/record.url?scp=85049666344&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85049666344&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-94944-4_18

DO - 10.1007/978-3-319-94944-4_18

M3 - Conference contribution

AN - SCOPUS:85049666344

SN - 9783319949437

T3 - Advances in Intelligent Systems and Computing

SP - 158

EP - 168

BT - Advances in Affective and Pleasurable Design - Proceedings of the AHFE 2018 International Conference on Affective and Pleasurable Design, 2018

A2 - Fukuda, Shuichi

PB - Springer Verlag

T2 - AHFE International Conference on Affective and Pleasurable Design, 2018

Y2 - 21 July 2018 through 25 July 2018

ER -

Two-dimensional emotion evaluation with multiple physiological signals

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this