Experimental study toward modeling of the uncanny valley based on eye movements on human/non-human faces

Yoshimasa Tawatsuji; Kazuaki Kojima; Tatsunori Matsui

doi:10.1007/978-3-642-39330-3_42

Experimental study toward modeling of the uncanny valley based on eye movements on human/non-human faces

Yoshimasa Tawatsuji, Kazuaki Kojima, Tatsunori Matsui

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

In the research field of human-agent interaction, it is a crucial issue to clarify the effect of agent appearances on human impressions. The uncanny valley is one crucial topic. We hypothesize that people can perceive a humanlike agent as human at an earlier stage in interaction even if they finally notice it as non-human and such contradictory perceptions are related to the uncanny valley. We conducted an experiment where participants were asked to judge whether faces presented on a PC monitor were human or not. The faces were a doll, a CG-modeled human image fairly similar to real human, an android robot, another image highly similar and a person. Eyes of the participants were recorded during watching the faces and changes in observing the faces were studied. The results indicate that eye data did not initially differ between the person and CG fairly similar, whereas differences emerged after several seconds. We then proposed a model of the uncanny valley based on dual pathway of emotion.

Original language	English
Title of host publication	Human-Computer Interaction
Subtitle of host publication	Interaction Modalities and Techniques - 15th International Conference, HCI International 2013, Proceedings
Pages	398-407
Number of pages	10
Edition	PART 4
DOIs	https://doi.org/10.1007/978-3-642-39330-3_42
Publication status	Published - 2013
Event	15th International Conference on Human-Computer Interaction, HCI International 2013 - Las Vegas, NV, United States Duration: 2013 Jul 21 → 2013 Jul 26

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Number	PART 4
Volume	8007 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	15th International Conference on Human-Computer Interaction, HCI International 2013
Country/Territory	United States
City	Las Vegas, NV
Period	13/7/21 → 13/7/26

Keywords

The uncanny valley
dual pathway of emotion
eye movements
humanlike agent

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-642-39330-3_42

Cite this

Tawatsuji, Y., Kojima, K., & Matsui, T. (2013). Experimental study toward modeling of the uncanny valley based on eye movements on human/non-human faces. In Human-Computer Interaction: Interaction Modalities and Techniques - 15th International Conference, HCI International 2013, Proceedings (PART 4 ed., pp. 398-407). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8007 LNCS, No. PART 4). https://doi.org/10.1007/978-3-642-39330-3_42

Experimental study toward modeling of the uncanny valley based on eye movements on human/non-human faces. / Tawatsuji, Yoshimasa; Kojima, Kazuaki; Matsui, Tatsunori.
Human-Computer Interaction: Interaction Modalities and Techniques - 15th International Conference, HCI International 2013, Proceedings. PART 4. ed. 2013. p. 398-407 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8007 LNCS, No. PART 4).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Tawatsuji, Y, Kojima, K & Matsui, T 2013, Experimental study toward modeling of the uncanny valley based on eye movements on human/non-human faces. in Human-Computer Interaction: Interaction Modalities and Techniques - 15th International Conference, HCI International 2013, Proceedings. PART 4 edn, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 4, vol. 8007 LNCS, pp. 398-407, 15th International Conference on Human-Computer Interaction, HCI International 2013, Las Vegas, NV, United States, 13/7/21. https://doi.org/10.1007/978-3-642-39330-3_42

Tawatsuji Y, Kojima K, Matsui T. Experimental study toward modeling of the uncanny valley based on eye movements on human/non-human faces. In Human-Computer Interaction: Interaction Modalities and Techniques - 15th International Conference, HCI International 2013, Proceedings. PART 4 ed. 2013. p. 398-407. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 4). doi: 10.1007/978-3-642-39330-3_42

Tawatsuji, Yoshimasa ; Kojima, Kazuaki ; Matsui, Tatsunori. / Experimental study toward modeling of the uncanny valley based on eye movements on human/non-human faces. Human-Computer Interaction: Interaction Modalities and Techniques - 15th International Conference, HCI International 2013, Proceedings. PART 4. ed. 2013. pp. 398-407 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 4).

@inproceedings{37902840e6534031bff80cf80eca6397,

title = "Experimental study toward modeling of the uncanny valley based on eye movements on human/non-human faces",

abstract = "In the research field of human-agent interaction, it is a crucial issue to clarify the effect of agent appearances on human impressions. The uncanny valley is one crucial topic. We hypothesize that people can perceive a humanlike agent as human at an earlier stage in interaction even if they finally notice it as non-human and such contradictory perceptions are related to the uncanny valley. We conducted an experiment where participants were asked to judge whether faces presented on a PC monitor were human or not. The faces were a doll, a CG-modeled human image fairly similar to real human, an android robot, another image highly similar and a person. Eyes of the participants were recorded during watching the faces and changes in observing the faces were studied. The results indicate that eye data did not initially differ between the person and CG fairly similar, whereas differences emerged after several seconds. We then proposed a model of the uncanny valley based on dual pathway of emotion.",

keywords = "The uncanny valley, dual pathway of emotion, eye movements, humanlike agent",

author = "Yoshimasa Tawatsuji and Kazuaki Kojima and Tatsunori Matsui",

year = "2013",

doi = "10.1007/978-3-642-39330-3_42",

language = "English",

isbn = "9783642393297",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

number = "PART 4",

pages = "398--407",

booktitle = "Human-Computer Interaction",

edition = "PART 4",

note = "15th International Conference on Human-Computer Interaction, HCI International 2013 ; Conference date: 21-07-2013 Through 26-07-2013",

}

TY - GEN

T1 - Experimental study toward modeling of the uncanny valley based on eye movements on human/non-human faces

AU - Tawatsuji, Yoshimasa

AU - Kojima, Kazuaki

AU - Matsui, Tatsunori

PY - 2013

Y1 - 2013

N2 - In the research field of human-agent interaction, it is a crucial issue to clarify the effect of agent appearances on human impressions. The uncanny valley is one crucial topic. We hypothesize that people can perceive a humanlike agent as human at an earlier stage in interaction even if they finally notice it as non-human and such contradictory perceptions are related to the uncanny valley. We conducted an experiment where participants were asked to judge whether faces presented on a PC monitor were human or not. The faces were a doll, a CG-modeled human image fairly similar to real human, an android robot, another image highly similar and a person. Eyes of the participants were recorded during watching the faces and changes in observing the faces were studied. The results indicate that eye data did not initially differ between the person and CG fairly similar, whereas differences emerged after several seconds. We then proposed a model of the uncanny valley based on dual pathway of emotion.

AB - In the research field of human-agent interaction, it is a crucial issue to clarify the effect of agent appearances on human impressions. The uncanny valley is one crucial topic. We hypothesize that people can perceive a humanlike agent as human at an earlier stage in interaction even if they finally notice it as non-human and such contradictory perceptions are related to the uncanny valley. We conducted an experiment where participants were asked to judge whether faces presented on a PC monitor were human or not. The faces were a doll, a CG-modeled human image fairly similar to real human, an android robot, another image highly similar and a person. Eyes of the participants were recorded during watching the faces and changes in observing the faces were studied. The results indicate that eye data did not initially differ between the person and CG fairly similar, whereas differences emerged after several seconds. We then proposed a model of the uncanny valley based on dual pathway of emotion.

KW - The uncanny valley

KW - dual pathway of emotion

KW - eye movements

KW - humanlike agent

UR - http://www.scopus.com/inward/record.url?scp=84880647861&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84880647861&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-39330-3_42

DO - 10.1007/978-3-642-39330-3_42

M3 - Conference contribution

AN - SCOPUS:84880647861

SN - 9783642393297

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 398

EP - 407

BT - Human-Computer Interaction

T2 - 15th International Conference on Human-Computer Interaction, HCI International 2013

Y2 - 21 July 2013 through 26 July 2013

ER -

Experimental study toward modeling of the uncanny valley based on eye movements on human/non-human faces

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this