Transcribing vocal expression from polyphonic music

Yukara Ikemiya; Katsutoshi Itoyama; Hiroshi G. Okuno

doi:10.1109/ICASSP.2014.6854176

Transcribing vocal expression from polyphonic music

Yukara Ikemiya, Katsutoshi Itoyama, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

6 Citations (Scopus)

Abstract

A method for transcribing vocal expressions such as vibrato, glissando, and kobushi separately from polyphonic music is described. The expressions appear as fluctuation in the fundamental frequency contour of the singing voice. They can be used for search and retrieval of music and for expressive singing voice synthesis based on singing style since they strongly reflect the individuality of the singer. The fundamental frequency contour of the singing voice is estimated using the Viterbi algorithm with limitation from a corresponding note sequence. Next, the notes are aligned with the fundamental frequency sequence temporally. Finally, each expression is identified and parameterized in accordance with designed rules. Experiments demonstrated that this method can transcribe expressions in the singing voice from commercial recordings.

Original language	English
Title of host publication	ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	3127-3131
Number of pages	5
ISBN (Print)	9781479928927
DOIs	https://doi.org/10.1109/ICASSP.2014.6854176
Publication status	Published - 2014
Externally published	Yes
Event	2014 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2014 - Florence Duration: 2014 May 4 → 2014 May 9

Other

Other	2014 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2014
City	Florence
Period	14/5/4 → 14/5/9

Keywords

F0 estimation
Singing voice analysis
Vocal expression identification / transcription

ASJC Scopus subject areas

Signal Processing
Software
Electrical and Electronic Engineering

Access to Document

10.1109/ICASSP.2014.6854176

Cite this

Transcribing vocal expression from polyphonic music. / Ikemiya, Yukara; Itoyama, Katsutoshi; Okuno, Hiroshi G.
ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2014. p. 3127-3131 6854176.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Ikemiya, Y, Itoyama, K & Okuno, HG 2014, Transcribing vocal expression from polyphonic music. in ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings., 6854176, Institute of Electrical and Electronics Engineers Inc., pp. 3127-3131, 2014 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2014, Florence, 14/5/4. https://doi.org/10.1109/ICASSP.2014.6854176

@inproceedings{b8a0a695870f4521b7dcc46c26419ee7,

title = "Transcribing vocal expression from polyphonic music",

abstract = "A method for transcribing vocal expressions such as vibrato, glissando, and kobushi separately from polyphonic music is described. The expressions appear as fluctuation in the fundamental frequency contour of the singing voice. They can be used for search and retrieval of music and for expressive singing voice synthesis based on singing style since they strongly reflect the individuality of the singer. The fundamental frequency contour of the singing voice is estimated using the Viterbi algorithm with limitation from a corresponding note sequence. Next, the notes are aligned with the fundamental frequency sequence temporally. Finally, each expression is identified and parameterized in accordance with designed rules. Experiments demonstrated that this method can transcribe expressions in the singing voice from commercial recordings.",

keywords = "F0 estimation, Singing voice analysis, Vocal expression identification / transcription",

author = "Yukara Ikemiya and Katsutoshi Itoyama and Okuno, {Hiroshi G.}",

year = "2014",

doi = "10.1109/ICASSP.2014.6854176",

language = "English",

isbn = "9781479928927",

pages = "3127--3131",

booktitle = "ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

note = "2014 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2014 ; Conference date: 04-05-2014 Through 09-05-2014",

}

TY - GEN

T1 - Transcribing vocal expression from polyphonic music

AU - Ikemiya, Yukara

AU - Itoyama, Katsutoshi

AU - Okuno, Hiroshi G.

PY - 2014

Y1 - 2014

N2 - A method for transcribing vocal expressions such as vibrato, glissando, and kobushi separately from polyphonic music is described. The expressions appear as fluctuation in the fundamental frequency contour of the singing voice. They can be used for search and retrieval of music and for expressive singing voice synthesis based on singing style since they strongly reflect the individuality of the singer. The fundamental frequency contour of the singing voice is estimated using the Viterbi algorithm with limitation from a corresponding note sequence. Next, the notes are aligned with the fundamental frequency sequence temporally. Finally, each expression is identified and parameterized in accordance with designed rules. Experiments demonstrated that this method can transcribe expressions in the singing voice from commercial recordings.

AB - A method for transcribing vocal expressions such as vibrato, glissando, and kobushi separately from polyphonic music is described. The expressions appear as fluctuation in the fundamental frequency contour of the singing voice. They can be used for search and retrieval of music and for expressive singing voice synthesis based on singing style since they strongly reflect the individuality of the singer. The fundamental frequency contour of the singing voice is estimated using the Viterbi algorithm with limitation from a corresponding note sequence. Next, the notes are aligned with the fundamental frequency sequence temporally. Finally, each expression is identified and parameterized in accordance with designed rules. Experiments demonstrated that this method can transcribe expressions in the singing voice from commercial recordings.

KW - F0 estimation

KW - Singing voice analysis

KW - Vocal expression identification / transcription

UR - http://www.scopus.com/inward/record.url?scp=84905276862&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84905276862&partnerID=8YFLogxK

U2 - 10.1109/ICASSP.2014.6854176

DO - 10.1109/ICASSP.2014.6854176

M3 - Conference contribution

AN - SCOPUS:84905276862

SN - 9781479928927

SP - 3127

EP - 3131

BT - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2014 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2014

Y2 - 4 May 2014 through 9 May 2014

ER -

Transcribing vocal expression from polyphonic music

Abstract

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this