Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music

Takuma Otsuka; Takeshi Mizumoto; Kazuhiro Nakadai; Toru Takahashi; Kazunori Komatani; Tetsuya Ogata; Hiroshi G. Okuno

doi:10.1007/978-3-642-13022-9_11

Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music

Takuma Otsuka^*, Takeshi Mizumoto, Kazuhiro Nakadai, Toru Takahashi, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

7 Citations (Scopus)

Abstract

Our goal is to achieve a musical ensemble among a robot and human musicians where the robot listens to the music with its own microphones. The main issues are (1) robust beat-tracking since the robot hears its own generated sounds in addition to the accompanied music, and (2) robust synchronizing its performance with the accompanied music even if humans' musical performance fluctuates. This paper presents a music-ensemble Thereminist robot implemented on the humanoid HRP-2 with the following three functions: (1) self-generated Theremin sound suppression by semi-blind Independent Component Analysis, (2) beat tracking robust against tempo fluctuation in humans' performance, and (3) feedforward control of Theremin pitch. Experimental results with a human drummer show the capability of this robot for the adaptation to the temporal fluctuation in his performance.

Original language	English
Title of host publication	Trends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings
Pages	102-112
Number of pages	11
Edition	PART 1
DOIs	https://doi.org/10.1007/978-3-642-13022-9_11
Publication status	Published - 2010
Externally published	Yes
Event	23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligence Systems, IEA/AIE 2010 - Cordoba, Spain Duration: 2010 Jun 1 → 2010 Jun 4

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Number	PART 1
Volume	6096 LNAI
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligence Systems, IEA/AIE 2010
Country/Territory	Spain
City	Cordoba
Period	10/6/1 → 10/6/4

Keywords

Beat tracking
Music robot
Musical human-robot interaction
Theremin

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-642-13022-9_11

Cite this

Otsuka, T., Mizumoto, T., Nakadai, K., Takahashi, T., Komatani, K., Ogata, T., & Okuno, H. G. (2010). Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music. In Trends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings (PART 1 ed., pp. 102-112). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6096 LNAI, No. PART 1). https://doi.org/10.1007/978-3-642-13022-9_11

Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music. / Otsuka, Takuma; Mizumoto, Takeshi; Nakadai, Kazuhiro et al.
Trends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings. PART 1. ed. 2010. p. 102-112 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6096 LNAI, No. PART 1).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Otsuka, T, Mizumoto, T, Nakadai, K, Takahashi, T, Komatani, K, Ogata, T & Okuno, HG 2010, Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music. in Trends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings. PART 1 edn, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 1, vol. 6096 LNAI, pp. 102-112, 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligence Systems, IEA/AIE 2010, Cordoba, Spain, 10/6/1. https://doi.org/10.1007/978-3-642-13022-9_11

Otsuka T, Mizumoto T, Nakadai K, Takahashi T, Komatani K, Ogata T et al. Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music. In Trends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings. PART 1 ed. 2010. p. 102-112. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1). doi: 10.1007/978-3-642-13022-9_11

Otsuka, Takuma ; Mizumoto, Takeshi ; Nakadai, Kazuhiro et al. / Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music. Trends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings. PART 1. ed. 2010. pp. 102-112 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1).

@inproceedings{16eefe82b6624ab8969cbcbf37cd1e15,

title = "Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music",

abstract = "Our goal is to achieve a musical ensemble among a robot and human musicians where the robot listens to the music with its own microphones. The main issues are (1) robust beat-tracking since the robot hears its own generated sounds in addition to the accompanied music, and (2) robust synchronizing its performance with the accompanied music even if humans' musical performance fluctuates. This paper presents a music-ensemble Thereminist robot implemented on the humanoid HRP-2 with the following three functions: (1) self-generated Theremin sound suppression by semi-blind Independent Component Analysis, (2) beat tracking robust against tempo fluctuation in humans' performance, and (3) feedforward control of Theremin pitch. Experimental results with a human drummer show the capability of this robot for the adaptation to the temporal fluctuation in his performance.",

keywords = "Beat tracking, Music robot, Musical human-robot interaction, Theremin",

author = "Takuma Otsuka and Takeshi Mizumoto and Kazuhiro Nakadai and Toru Takahashi and Kazunori Komatani and Tetsuya Ogata and Okuno, {Hiroshi G.}",

year = "2010",

doi = "10.1007/978-3-642-13022-9_11",

language = "English",

isbn = "3642130216",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

number = "PART 1",

pages = "102--112",

booktitle = "Trends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings",

edition = "PART 1",

note = "23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligence Systems, IEA/AIE 2010 ; Conference date: 01-06-2010 Through 04-06-2010",

}

TY - GEN

T1 - Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music

AU - Otsuka, Takuma

AU - Mizumoto, Takeshi

AU - Nakadai, Kazuhiro

AU - Takahashi, Toru

AU - Komatani, Kazunori

AU - Ogata, Tetsuya

AU - Okuno, Hiroshi G.

PY - 2010

Y1 - 2010

N2 - Our goal is to achieve a musical ensemble among a robot and human musicians where the robot listens to the music with its own microphones. The main issues are (1) robust beat-tracking since the robot hears its own generated sounds in addition to the accompanied music, and (2) robust synchronizing its performance with the accompanied music even if humans' musical performance fluctuates. This paper presents a music-ensemble Thereminist robot implemented on the humanoid HRP-2 with the following three functions: (1) self-generated Theremin sound suppression by semi-blind Independent Component Analysis, (2) beat tracking robust against tempo fluctuation in humans' performance, and (3) feedforward control of Theremin pitch. Experimental results with a human drummer show the capability of this robot for the adaptation to the temporal fluctuation in his performance.

AB - Our goal is to achieve a musical ensemble among a robot and human musicians where the robot listens to the music with its own microphones. The main issues are (1) robust beat-tracking since the robot hears its own generated sounds in addition to the accompanied music, and (2) robust synchronizing its performance with the accompanied music even if humans' musical performance fluctuates. This paper presents a music-ensemble Thereminist robot implemented on the humanoid HRP-2 with the following three functions: (1) self-generated Theremin sound suppression by semi-blind Independent Component Analysis, (2) beat tracking robust against tempo fluctuation in humans' performance, and (3) feedforward control of Theremin pitch. Experimental results with a human drummer show the capability of this robot for the adaptation to the temporal fluctuation in his performance.

KW - Beat tracking

KW - Music robot

KW - Musical human-robot interaction

KW - Theremin

UR - http://www.scopus.com/inward/record.url?scp=79551525401&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79551525401&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-13022-9_11

DO - 10.1007/978-3-642-13022-9_11

M3 - Conference contribution

AN - SCOPUS:79551525401

SN - 3642130216

SN - 9783642130212

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 102

EP - 112

BT - Trends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings

T2 - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligence Systems, IEA/AIE 2010

Y2 - 1 June 2010 through 4 June 2010

ER -

Music-ensemble robot that is capable of playing the Theremin while listening to the accompanied music

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this