CNN-based virtual microphone signal estimation for MPDR beamforming in underdetermined situations

Kouei Yamaoka, Li L. Li, Nobutaka Ono, Shoji Makino, Takeshi Yamada

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)


In this paper, we propose a novel approach to virtually increasing the number of microphone elements between two real microphones to improve speech enhancement performance in underdetermined situations. The virtual microphone technique, with which virtual signals in the audio signal domain are estimated by linearly interpolating the phase and nonlinearly interpolating the amplitude independently on the basis of βdivergence, has been recently proposed and experimentally shown to be effective in improving speech enhancement performance. Furthermore, it has been reported that the performance tends to improve as the nonlinearity is improved. However, one drawback of this method is that the interpolation is employed in each time-frequency bin independently, in which the spectral and temporal structures of speech signals are ignored. To address this problem and improve the nonlinearity, motivated by the high capability of neural networks to model nonlinear functions and speech spectrograms, in this paper, we propose an alternative method of amplitude interpolation. In this method, we employ a convolutional neural network as an amplitude estimator that minimizes the mean squared error between the outputs of a minimum power distortionless response (MPDR) beamformer and the target speech signals. The experimental results revealed that the proposed method showed high potential for improving speech enhancement performance, which was not only superior to that of the conventional virtual microphone technique but also the performance in the corresponding determined situation.

Original languageEnglish
Title of host publicationEUSIPCO 2019 - 27th European Signal Processing Conference
PublisherEuropean Signal Processing Conference, EUSIPCO
ISBN (Electronic)9789082797039
Publication statusPublished - 2019 Sept
Externally publishedYes
Event27th European Signal Processing Conference, EUSIPCO 2019 - A Coruna, Spain
Duration: 2019 Sept 22019 Sept 6

Publication series

NameEuropean Signal Processing Conference
ISSN (Print)2219-5491


Conference27th European Signal Processing Conference, EUSIPCO 2019
CityA Coruna

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering


Dive into the research topics of 'CNN-based virtual microphone signal estimation for MPDR beamforming in underdetermined situations'. Together they form a unique fingerprint.

Cite this