Mixed Reality Visualization of Room Impulse Responses on Two Planes by Moving Microphone

Yasuaki Watanabe, Yusuke Ikeda, Yasuhiro Oikawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Mixed Reality (MR) can be used to visualize three-dimensional (3D) sound fields in real space. In our previous study, we proposed a sound intensity visualization system using MR. The system visualizes the flow of sound energy in a stationary sound field by measuring sound intensity. However, room impulse responses (RIRs) are essential data when investigating the sound field of a room. Therefore, to demystify the time variation of the sound field, it is crucial to visualize the spatial distribution of RIRs. However, the measurement of multipoint RIRs requires considerable time and effort and a large microphone array. In this paper, we propose an MR visualization system for RIR mapping on two planes based on dynamic RIR measurement using a moving microphone. The proposed system simplifies the measurement of RIRs at multiple points owing to the dynamic measurement capabilities of a hand-held microphone. In the simulation experiment, the RIRs on the grid points were estimated from the microphone signal using the moving path of the microphone. The estimated results were visualized by the animation of RIR maps in real space using MR. From the experimental results, the MR animation of RIR maps on the two orthogonal planes can help demystify 3D sound propagation.

Original languageEnglish
Title of host publicationInternational Workshop on Advanced Imaging Technology, IWAIT 2022
EditorsMasayuki Nakajima, Shogo Muramatsu, Jae-Gon Kim, Jing-Ming Guo, Qian Kemao
PublisherSPIE
ISBN (Electronic)9781510653313
DOIs
Publication statusPublished - 2022
Event2022 International Workshop on Advanced Imaging Technology, IWAIT 2022 - Hong Kong, China
Duration: 2022 Jan 42022 Jan 6

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume12177
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference2022 International Workshop on Advanced Imaging Technology, IWAIT 2022
Country/TerritoryChina
CityHong Kong
Period22/1/422/1/6

Keywords

  • Dynamic sound-field measurement
  • Microsoft HoloLens
  • Sound field interpolation
  • Sound propagation

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Mixed Reality Visualization of Room Impulse Responses on Two Planes by Moving Microphone'. Together they form a unique fingerprint.

Cite this