Multi-person Conversation via Multi-modal Interface - A Robot who Communicate with Multi-user -

Yosuke Matsusaka; Tsuyoshi Tojo; Sentaro Kubota; Kenji Furukawa; Daisuke Tamiya; Keisuke Hayata; Yuichiro Nakano; Tetsunori Kobayashi

Multi-person Conversation via Multi-modal Interface - A Robot who Communicate with Multi-user -

Yosuke Matsusaka^*, Tsuyoshi Tojo, Sentaro Kubota, Kenji Furukawa, Daisuke Tamiya, Keisuke Hayata, Yuichiro Nakano, Tetsunori Kobayashi

^*Corresponding author for this work

School of Fundamental Science and Engineering

Research output: Contribution to conference › Paper › peer-review

66 Citations (Scopus)

Abstract

This paper describes a robot who converses with multi-person using his multi-modal interface. The multi-person conversation includes many new problems, which are not cared in the conventional one-to-one conversation: such as information flow problems (recognizing who is speaking and to whom he is speaking/appealing to whom the system is speaking), space information sharing problem and turn holder estimation problem (estimating who is the next speaker). We solved these problems by utilizing multi-modal interface: face direction recognition, gesture recognition, sound direction recognition, speech recognition and gestural expression. The systematic combination of these functions realized human friendly multi-person conversation system.

Original language	English
Pages	1723-1726
Number of pages	4
Publication status	Published - 1999
Event	6th European Conference on Speech Communication and Technology, EUROSPEECH 1999 - Budapest, Hungary Duration: 1999 Sept 5 → 1999 Sept 9

Conference

Conference	6th European Conference on Speech Communication and Technology, EUROSPEECH 1999
Country/Territory	Hungary
City	Budapest
Period	99/9/5 → 99/9/9

ASJC Scopus subject areas

Computer Science Applications
Software
Linguistics and Language
Communication

Cite this

@conference{d5c34c62a6254d1a966e5657220f67b1,

title = "Multi-person Conversation via Multi-modal Interface - A Robot who Communicate with Multi-user -",

abstract = "This paper describes a robot who converses with multi-person using his multi-modal interface. The multi-person conversation includes many new problems, which are not cared in the conventional one-to-one conversation: such as information flow problems (recognizing who is speaking and to whom he is speaking/appealing to whom the system is speaking), space information sharing problem and turn holder estimation problem (estimating who is the next speaker). We solved these problems by utilizing multi-modal interface: face direction recognition, gesture recognition, sound direction recognition, speech recognition and gestural expression. The systematic combination of these functions realized human friendly multi-person conversation system.",

author = "Yosuke Matsusaka and Tsuyoshi Tojo and Sentaro Kubota and Kenji Furukawa and Daisuke Tamiya and Keisuke Hayata and Yuichiro Nakano and Tetsunori Kobayashi",

note = "Publisher Copyright: {\textcopyright} 1999 6th European Conference on Speech Communication and Technology, EUROSPEECH 1999. All rights reserved.; 6th European Conference on Speech Communication and Technology, EUROSPEECH 1999 ; Conference date: 05-09-1999 Through 09-09-1999",

year = "1999",

language = "English",

pages = "1723--1726",

}

TY - CONF

T1 - Multi-person Conversation via Multi-modal Interface - A Robot who Communicate with Multi-user -

AU - Matsusaka, Yosuke

AU - Tojo, Tsuyoshi

AU - Kubota, Sentaro

AU - Furukawa, Kenji

AU - Tamiya, Daisuke

AU - Hayata, Keisuke

AU - Nakano, Yuichiro

AU - Kobayashi, Tetsunori

PY - 1999

Y1 - 1999

N2 - This paper describes a robot who converses with multi-person using his multi-modal interface. The multi-person conversation includes many new problems, which are not cared in the conventional one-to-one conversation: such as information flow problems (recognizing who is speaking and to whom he is speaking/appealing to whom the system is speaking), space information sharing problem and turn holder estimation problem (estimating who is the next speaker). We solved these problems by utilizing multi-modal interface: face direction recognition, gesture recognition, sound direction recognition, speech recognition and gestural expression. The systematic combination of these functions realized human friendly multi-person conversation system.

AB - This paper describes a robot who converses with multi-person using his multi-modal interface. The multi-person conversation includes many new problems, which are not cared in the conventional one-to-one conversation: such as information flow problems (recognizing who is speaking and to whom he is speaking/appealing to whom the system is speaking), space information sharing problem and turn holder estimation problem (estimating who is the next speaker). We solved these problems by utilizing multi-modal interface: face direction recognition, gesture recognition, sound direction recognition, speech recognition and gestural expression. The systematic combination of these functions realized human friendly multi-person conversation system.

UR - http://www.scopus.com/inward/record.url?scp=85135270160&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85135270160&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:85135270160

SP - 1723

EP - 1726

T2 - 6th European Conference on Speech Communication and Technology, EUROSPEECH 1999

Y2 - 5 September 1999 through 9 September 1999

ER -

Multi-person Conversation via Multi-modal Interface - A Robot who Communicate with Multi-user -

Abstract

Conference

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this