A MULTIMODAL DATABASE OF GESTURES AND SPEECH

Satoru Hayamizu; Shigeki Nagaya; Keiko Watanuki; Masayuki Nakazawa; Shuichi Nobe; Takashi Yoshimura

A MULTIMODAL DATABASE OF GESTURES AND SPEECH

Satoru Hayamizu^*, Shigeki Nagaya, Keiko Watanuki, Masayuki Nakazawa, Shuichi Nobe, Takashi Yoshimura

^*Corresponding author for this work

Research output: Contribution to conference › Paper › peer-review

2 Citations (Scopus)

Abstract

This paper describes a multimodal database which consists of image data of human gestures and corresponding speech data for the research on multimodal interaction systems. The purpose of this database is to provide an underlying foundation for research and development of multimodal interactive systems. Our primary concern in selecting utterances and gestures for inclusion in the database was to ascertain the kinds of expressions and gestures that artificial systems could produce and recognize. Total 25 kinds of gestures and speech were repeated four times for the recording of each subject. The speech and gestures for a total of 48 subjects were recorded, converted into files and in the first version, the files for 12 subjects were recorded on CD-ROMs.

Original language	English
Pages	2247-2250
Number of pages	4
Publication status	Published - 1999
Externally published	Yes
Event	6th European Conference on Speech Communication and Technology, EUROSPEECH 1999 - Budapest, Hungary Duration: 1999 Sept 5 → 1999 Sept 9

Conference

Conference	6th European Conference on Speech Communication and Technology, EUROSPEECH 1999
Country/Territory	Hungary
City	Budapest
Period	99/9/5 → 99/9/9

Keywords

database
gesture
multimodal

ASJC Scopus subject areas

Computer Science Applications
Software
Linguistics and Language
Communication

Cite this

@conference{3c4416318dba4c99b87708858310b848,

title = "A MULTIMODAL DATABASE OF GESTURES AND SPEECH",

abstract = "This paper describes a multimodal database which consists of image data of human gestures and corresponding speech data for the research on multimodal interaction systems. The purpose of this database is to provide an underlying foundation for research and development of multimodal interactive systems. Our primary concern in selecting utterances and gestures for inclusion in the database was to ascertain the kinds of expressions and gestures that artificial systems could produce and recognize. Total 25 kinds of gestures and speech were repeated four times for the recording of each subject. The speech and gestures for a total of 48 subjects were recorded, converted into files and in the first version, the files for 12 subjects were recorded on CD-ROMs.",

keywords = "database, gesture, multimodal",

author = "Satoru Hayamizu and Shigeki Nagaya and Keiko Watanuki and Masayuki Nakazawa and Shuichi Nobe and Takashi Yoshimura",

note = "Funding Information: This research was done under the Real World Computing Program. The authors would like to thank Mr. Hiroshi Matumura and Mr. Hiroumi Yamashita for the development of the database and the subjects for their contribution to providing their gestures and speech. Publisher Copyright: {\textcopyright} 1999 6th European Conference on Speech Communication and Technology, EUROSPEECH 1999. All rights reserved.; 6th European Conference on Speech Communication and Technology, EUROSPEECH 1999 ; Conference date: 05-09-1999 Through 09-09-1999",

year = "1999",

language = "English",

pages = "2247--2250",

}

TY - CONF

T1 - A MULTIMODAL DATABASE OF GESTURES AND SPEECH

AU - Hayamizu, Satoru

AU - Nagaya, Shigeki

AU - Watanuki, Keiko

AU - Nakazawa, Masayuki

AU - Nobe, Shuichi

AU - Yoshimura, Takashi

N1 - Funding Information: This research was done under the Real World Computing Program. The authors would like to thank Mr. Hiroshi Matumura and Mr. Hiroumi Yamashita for the development of the database and the subjects for their contribution to providing their gestures and speech. Publisher Copyright: © 1999 6th European Conference on Speech Communication and Technology, EUROSPEECH 1999. All rights reserved.

PY - 1999

Y1 - 1999

N2 - This paper describes a multimodal database which consists of image data of human gestures and corresponding speech data for the research on multimodal interaction systems. The purpose of this database is to provide an underlying foundation for research and development of multimodal interactive systems. Our primary concern in selecting utterances and gestures for inclusion in the database was to ascertain the kinds of expressions and gestures that artificial systems could produce and recognize. Total 25 kinds of gestures and speech were repeated four times for the recording of each subject. The speech and gestures for a total of 48 subjects were recorded, converted into files and in the first version, the files for 12 subjects were recorded on CD-ROMs.

AB - This paper describes a multimodal database which consists of image data of human gestures and corresponding speech data for the research on multimodal interaction systems. The purpose of this database is to provide an underlying foundation for research and development of multimodal interactive systems. Our primary concern in selecting utterances and gestures for inclusion in the database was to ascertain the kinds of expressions and gestures that artificial systems could produce and recognize. Total 25 kinds of gestures and speech were repeated four times for the recording of each subject. The speech and gestures for a total of 48 subjects were recorded, converted into files and in the first version, the files for 12 subjects were recorded on CD-ROMs.

KW - database

KW - gesture

KW - multimodal

UR - http://www.scopus.com/inward/record.url?scp=85009094642&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85009094642&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:85009094642

SP - 2247

EP - 2250

T2 - 6th European Conference on Speech Communication and Technology, EUROSPEECH 1999

Y2 - 5 September 1999 through 9 September 1999

ER -

A MULTIMODAL DATABASE OF GESTURES AND SPEECH

Abstract

Conference

Keywords

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this