Design and implementation of a robot audition system for automatic speech recognition of simultaneous speech

Shun'ichi Yamamoto; Kazuhiro Nakadai; Mikio Nakano; Hiroshi Tsujino; Jean Marc Valin; Kazunori Komatani; Tetsuya Ogata; Hiroshi G. Okuno

Design and implementation of a robot audition system for automatic speech recognition of simultaneous speech

Shun'ichi Yamamoto^*, Kazuhiro Nakadai, Mikio Nakano, Hiroshi Tsujino, Jean Marc Valin, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno

^*Corresponding author for this work

Research output: Contribution to conference › Paper › peer-review

21 Citations (Scopus)

Abstract

This paper addresses robot audition that can cope with speech that has a low signal-to-noise ratio (SNR) in real time by using robot-embedded microphones. To cope with such a noise, we exploited two key ideas; Preprocessing consisting of sound source localization and separation with a microphone array, and system integration based on missing feature theory (MFT). Preprocessing improves the SNR of a target sound signal using geometric source separation with multichannel post-filter. MFT uses only reliable acoustic features in speech recognition and masks unreliable parts caused by errors in preprocessing. MFT thus provides smooth integration between preprocessing and automatic speech recognition. A real-time robot audition system based on these two key ideas is constructed for Honda ASIMO and Humanoid SIG2 with 8-ch microphone arrays. The paper also reports the improvement of ASR performance by using two and three simultaneous speech signals.

Original language	English
Pages	111-116
Number of pages	6
Publication status	Published - 2007
Externally published	Yes
Event	2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007 - Kyoto, Japan Duration: 2007 Dec 9 → 2007 Dec 13

Conference

Conference	2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007
Country/Territory	Japan
City	Kyoto
Period	07/12/9 → 07/12/13

Keywords

Automatic speech recognition
Geometric source separation
Missing feature theory
Robot audition

ASJC Scopus subject areas

Computer Vision and Pattern Recognition
Software
Artificial Intelligence

Cite this

@conference{b5bf097ea81f43c0a842a078cb89ab77,

title = "Design and implementation of a robot audition system for automatic speech recognition of simultaneous speech",

abstract = "This paper addresses robot audition that can cope with speech that has a low signal-to-noise ratio (SNR) in real time by using robot-embedded microphones. To cope with such a noise, we exploited two key ideas; Preprocessing consisting of sound source localization and separation with a microphone array, and system integration based on missing feature theory (MFT). Preprocessing improves the SNR of a target sound signal using geometric source separation with multichannel post-filter. MFT uses only reliable acoustic features in speech recognition and masks unreliable parts caused by errors in preprocessing. MFT thus provides smooth integration between preprocessing and automatic speech recognition. A real-time robot audition system based on these two key ideas is constructed for Honda ASIMO and Humanoid SIG2 with 8-ch microphone arrays. The paper also reports the improvement of ASR performance by using two and three simultaneous speech signals.",

keywords = "Automatic speech recognition, Geometric source separation, Missing feature theory, Robot audition",

author = "Shun'ichi Yamamoto and Kazuhiro Nakadai and Mikio Nakano and Hiroshi Tsujino and Valin, {Jean Marc} and Kazunori Komatani and Tetsuya Ogata and Okuno, {Hiroshi G.}",

year = "2007",

language = "English",

pages = "111--116",

note = "2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007 ; Conference date: 09-12-2007 Through 13-12-2007",

}

TY - CONF

T1 - Design and implementation of a robot audition system for automatic speech recognition of simultaneous speech

AU - Yamamoto, Shun'ichi

AU - Nakadai, Kazuhiro

AU - Nakano, Mikio

AU - Tsujino, Hiroshi

AU - Valin, Jean Marc

AU - Komatani, Kazunori

AU - Ogata, Tetsuya

AU - Okuno, Hiroshi G.

PY - 2007

Y1 - 2007

N2 - This paper addresses robot audition that can cope with speech that has a low signal-to-noise ratio (SNR) in real time by using robot-embedded microphones. To cope with such a noise, we exploited two key ideas; Preprocessing consisting of sound source localization and separation with a microphone array, and system integration based on missing feature theory (MFT). Preprocessing improves the SNR of a target sound signal using geometric source separation with multichannel post-filter. MFT uses only reliable acoustic features in speech recognition and masks unreliable parts caused by errors in preprocessing. MFT thus provides smooth integration between preprocessing and automatic speech recognition. A real-time robot audition system based on these two key ideas is constructed for Honda ASIMO and Humanoid SIG2 with 8-ch microphone arrays. The paper also reports the improvement of ASR performance by using two and three simultaneous speech signals.

AB - This paper addresses robot audition that can cope with speech that has a low signal-to-noise ratio (SNR) in real time by using robot-embedded microphones. To cope with such a noise, we exploited two key ideas; Preprocessing consisting of sound source localization and separation with a microphone array, and system integration based on missing feature theory (MFT). Preprocessing improves the SNR of a target sound signal using geometric source separation with multichannel post-filter. MFT uses only reliable acoustic features in speech recognition and masks unreliable parts caused by errors in preprocessing. MFT thus provides smooth integration between preprocessing and automatic speech recognition. A real-time robot audition system based on these two key ideas is constructed for Honda ASIMO and Humanoid SIG2 with 8-ch microphone arrays. The paper also reports the improvement of ASR performance by using two and three simultaneous speech signals.

KW - Automatic speech recognition

KW - Geometric source separation

KW - Missing feature theory

KW - Robot audition

UR - http://www.scopus.com/inward/record.url?scp=44849118877&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=44849118877&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:44849118877

SP - 111

EP - 116

T2 - 2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007

Y2 - 9 December 2007 through 13 December 2007

ER -

Design and implementation of a robot audition system for automatic speech recognition of simultaneous speech

Abstract

Conference

Keywords

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this