Multiple moving speaker tracking by microphone array on mobile robot

Masamitsu Murase*, Shunichi Yamamoto, Jean Marc Valin, Kazuhiro Nakadai, Kentaro Yamada, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno


研究成果: Paper査読

17 被引用数 (Scopus)


Real-world applications often require tracking multiple moving speakers for improving human-robot interactions and/or sound source separation. This paper presents multiple moving speaker tracking using an 8ch microphone array system installed on a mobile robot. This problem is difficult because the system does not assume that sound sources and/or the microphone array are fixed. Our solutions consist of two key ideas - time delay of arrival estimation, and multiple Kalman filters. The former localizes multiple sound sources based on beamforming in real time. Non-linear movements are tracked by using a set of Kalman filters with different history lengths in order to reduce errors in tracking multiple moving speakers under noisy and echoic environments. For quantitative evaluation of the tracking, motion references of sound sources and a mobile robot, called SIG2, were measured accurately by ultrasonic 3D tag sensors. As a result, we showed that the system tracked three simultaneous sound sources even when SIG2 moved in a room with large reverberation due to glass walls.

出版ステータスPublished - 2005
イベント9th European Conference on Speech Communication and Technology - Lisbon, Portugal
継続期間: 2005 9月 42005 9月 8


Conference9th European Conference on Speech Communication and Technology

ASJC Scopus subject areas

  • 工学一般


「Multiple moving speaker tracking by microphone array on mobile robot」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。