Allocentric emotional affordances in HRI: The multimodal binding

Jordi Vallverdú; Gabriele Trovato; Lorenzo Jamone

doi:10.3390/mti2040078

Allocentric emotional affordances in HRI: The multimodal binding

Jordi Vallverdú^*, Gabriele Trovato, Lorenzo Jamone

^*Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

5 Citations (Scopus)

Abstract

The concept of affordance perception is one of the distinctive traits of human cognition; and its application to robots can dramatically improve the quality of human-robot interaction (HRI). In this paper we explore and discuss the idea of “emotional affordances” by proposing a viable model for implementation into HRI; which considers allocentric and multimodal perception. We consider “2-ways” affordances: perceived object triggering an emotion; and perceived human emotion expression triggering an action. In order to make the implementation generic; the proposed model includes a library that can be customised depending on the specific robot and application scenario. We present the AAA (Affordance-Appraisal-Arousal) model; which incorporates Plutchik’s Wheel of Emotions; and we outline some numerical examples of how it can be used in different scenarios.

Original language	English
Article number	78
Journal	Multimodal Technologies and Interaction
Volume	2
Issue number	4
DOIs	https://doi.org/10.3390/mti2040078
Publication status	Published - 2018 Dec
Externally published	Yes

Keywords

Affordance
Allocentric
Emotion
Empathy
HRI
Libraries
Multimodal

ASJC Scopus subject areas

Neuroscience (miscellaneous)
Human-Computer Interaction
Computer Science Applications
Computer Networks and Communications

Access to Document

10.3390/mti2040078

Cite this

@article{265e584c498b41c5bc904cf777a0ab31,

title = "Allocentric emotional affordances in HRI: The multimodal binding",

abstract = "The concept of affordance perception is one of the distinctive traits of human cognition; and its application to robots can dramatically improve the quality of human-robot interaction (HRI). In this paper we explore and discuss the idea of “emotional affordances” by proposing a viable model for implementation into HRI; which considers allocentric and multimodal perception. We consider “2-ways” affordances: perceived object triggering an emotion; and perceived human emotion expression triggering an action. In order to make the implementation generic; the proposed model includes a library that can be customised depending on the specific robot and application scenario. We present the AAA (Affordance-Appraisal-Arousal) model; which incorporates Plutchik{\textquoteright}s Wheel of Emotions; and we outline some numerical examples of how it can be used in different scenarios.",

keywords = "Affordance, Allocentric, Emotion, Empathy, HRI, Libraries, Multimodal",

author = "Jordi Vallverd{\'u} and Gabriele Trovato and Lorenzo Jamone",

note = "Funding Information: Acknowledgments: Vallverd{\'u}{\textquoteright}s studies have been supported by MICINN Grant (FFI2017-85711-P). Publisher Copyright: {\textcopyright} 2018 by the authors. Licensee MDPI, Basel, Switzerland.",

year = "2018",

month = dec,

doi = "10.3390/mti2040078",

language = "English",

volume = "2",

journal = "Multimodal Technologies and Interaction",

issn = "2414-4088",

publisher = "MDPI AG",

number = "4",

}

TY - JOUR

T1 - Allocentric emotional affordances in HRI

T2 - The multimodal binding

AU - Vallverdú, Jordi

AU - Trovato, Gabriele

AU - Jamone, Lorenzo

PY - 2018/12

Y1 - 2018/12

N2 - The concept of affordance perception is one of the distinctive traits of human cognition; and its application to robots can dramatically improve the quality of human-robot interaction (HRI). In this paper we explore and discuss the idea of “emotional affordances” by proposing a viable model for implementation into HRI; which considers allocentric and multimodal perception. We consider “2-ways” affordances: perceived object triggering an emotion; and perceived human emotion expression triggering an action. In order to make the implementation generic; the proposed model includes a library that can be customised depending on the specific robot and application scenario. We present the AAA (Affordance-Appraisal-Arousal) model; which incorporates Plutchik’s Wheel of Emotions; and we outline some numerical examples of how it can be used in different scenarios.

AB - The concept of affordance perception is one of the distinctive traits of human cognition; and its application to robots can dramatically improve the quality of human-robot interaction (HRI). In this paper we explore and discuss the idea of “emotional affordances” by proposing a viable model for implementation into HRI; which considers allocentric and multimodal perception. We consider “2-ways” affordances: perceived object triggering an emotion; and perceived human emotion expression triggering an action. In order to make the implementation generic; the proposed model includes a library that can be customised depending on the specific robot and application scenario. We present the AAA (Affordance-Appraisal-Arousal) model; which incorporates Plutchik’s Wheel of Emotions; and we outline some numerical examples of how it can be used in different scenarios.

KW - Affordance

KW - Allocentric

KW - Emotion

KW - Empathy

KW - HRI

KW - Libraries

KW - Multimodal

UR - http://www.scopus.com/inward/record.url?scp=85078723913&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85078723913&partnerID=8YFLogxK

U2 - 10.3390/mti2040078

DO - 10.3390/mti2040078

M3 - Article

AN - SCOPUS:85078723913

SN - 2414-4088

VL - 2

JO - Multimodal Technologies and Interaction

JF - Multimodal Technologies and Interaction

IS - 4

M1 - 78

ER -

Allocentric emotional affordances in HRI: The multimodal binding

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this