TY - JOUR
T1 - Far-Field Automatic Speech Recognition
AU - Haeb-Umbach, Reinhold
AU - Heymann, Jahn
AU - Drude, Lukas
AU - Watanabe, Shinji
AU - Delcroix, Marc
AU - Nakatani, Tomohiro
N1 - Funding Information:
Manuscript received December 22, 2019; revised June 9, 2020; accepted August 13, 2020. Date of publication September 9, 2020; date of current version January 20, 2021. The work of Jahn Heymann and Lukas Drude was supported in part by the Google Faculty Research Award. (Corresponding author: Reinhold Haeb-Umbach.) Reinhold Haeb-Umbach is with the Department of Communications Engineering, Paderborn University, 33098 Paderborn, Germany (e-mail: haeb@nt.uni-paderborn.de). Jahn Heymann and Lukas Drude are with Amazon.com Inc., 52064 Aachen, Germany. Shinji Watanabe is with the Center for Language and Speech Processing, Johns Hopkins University, Baltimore, MD 21218 USA. Marc Delcroix and Tomohiro Nakatani are with Nippon Telegraph and Telephone Corporation, Kyoto, Japan.
Publisher Copyright:
© 1963-2012 IEEE.
PY - 2021/2
Y1 - 2021/2
N2 - The machine recognition of speech spoken at a distance from the microphones, known as far-field automatic speech recognition (ASR), has received a significant increase in attention in science and industry, which caused or was caused by an equally significant improvement in recognition accuracy. Meanwhile, it has entered the consumer market with digital home assistants with a spoken language interface being its most prominent application. Speech recorded at a distance is affected by various acoustic distortions, and consequently, quite different processing pipelines have emerged compared with ASR for close-Talk speech. A signal enhancement front end for dereverberation, source separation, and acoustic beamforming is employed to clean up the speech, and the back-end ASR engine is robustified by multicondition training and adaptation. We will also describe the so-called end-To-end approach to ASR, which is a new promising architecture that has recently been extended to the far-field scenario. This tutorial article gives an account of the algorithms used to enable accurate speech recognition from a distance, and it will be seen that, although deep learning has a significant share in the technological breakthroughs, a clever combination with traditional signal processing can lead to surprisingly effective solutions.
AB - The machine recognition of speech spoken at a distance from the microphones, known as far-field automatic speech recognition (ASR), has received a significant increase in attention in science and industry, which caused or was caused by an equally significant improvement in recognition accuracy. Meanwhile, it has entered the consumer market with digital home assistants with a spoken language interface being its most prominent application. Speech recorded at a distance is affected by various acoustic distortions, and consequently, quite different processing pipelines have emerged compared with ASR for close-Talk speech. A signal enhancement front end for dereverberation, source separation, and acoustic beamforming is employed to clean up the speech, and the back-end ASR engine is robustified by multicondition training and adaptation. We will also describe the so-called end-To-end approach to ASR, which is a new promising architecture that has recently been extended to the far-field scenario. This tutorial article gives an account of the algorithms used to enable accurate speech recognition from a distance, and it will be seen that, although deep learning has a significant share in the technological breakthroughs, a clever combination with traditional signal processing can lead to surprisingly effective solutions.
KW - Acoustic beamforming
KW - automatic speech recognition (ASR)
KW - dereverberation
KW - end-To-end speech recognition
KW - speech enhancement
UR - http://www.scopus.com/inward/record.url?scp=85090984883&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85090984883&partnerID=8YFLogxK
U2 - 10.1109/JPROC.2020.3018668
DO - 10.1109/JPROC.2020.3018668
M3 - Article
AN - SCOPUS:85090984883
SN - 0018-9219
VL - 109
SP - 124
EP - 148
JO - Proceedings of the Institute of Radio Engineers
JF - Proceedings of the Institute of Radio Engineers
IS - 2
M1 - 9189820
ER -