Visualization of auditory awareness based on sound source positions estimated by depth sensor and microphone array

Takahiro Iyama; Osamu Sugiyama; Takuma Otsuka; Katsutoshi Itoyama; Hiroshi G. Okuno

doi:10.1109/IROS.2014.6942814

Visualization of auditory awareness based on sound source positions estimated by depth sensor and microphone array

Takahiro Iyama, Osamu Sugiyama, Takuma Otsuka, Katsutoshi Itoyama, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

4 Citations (Scopus)

Abstract

We have developed a system for visualizing auditory awareness on the basis of sound source locations estimated using a depth sensor and microphone array. Previous studies on visualizing the acoustic environment viewed the level of sound pressures directly on the captured image, so the visualization was often based on a mixture of several sound sources. As a result, which targets to focus on was not intuitive. To help users selectively to find the targets and focus on the target analysis, we should extract the captured acoustic information and selectively propose it with the user demand. We have designed a three-layer visualization model for auditory awareness consisting of a sound source distribution layer, a sound location layer, and a sound saliency layer. The model extracts acoustic information by using the depth image and multi-directional sound sources captured with a depth sensor and microphone array. This model is used in the system we developed for visualizing auditory awareness.

Original language	English
Title of host publication	IEEE International Conference on Intelligent Robots and Systems
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1908-1913
Number of pages	6
ISBN (Print)	9781479969340
DOIs	https://doi.org/10.1109/IROS.2014.6942814
Publication status	Published - 2014 Oct 31
Externally published	Yes
Event	2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2014 - Chicago Duration: 2014 Sept 14 → 2014 Sept 18

Other

Other	2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2014
City	Chicago
Period	14/9/14 → 14/9/18

ASJC Scopus subject areas

Control and Systems Engineering
Software
Computer Vision and Pattern Recognition
Computer Science Applications

Access to Document

10.1109/IROS.2014.6942814

Cite this

Iyama, T., Sugiyama, O., Otsuka, T., Itoyama, K., & Okuno, H. G. (2014). Visualization of auditory awareness based on sound source positions estimated by depth sensor and microphone array. In IEEE International Conference on Intelligent Robots and Systems (pp. 1908-1913). Article 6942814 Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IROS.2014.6942814

Visualization of auditory awareness based on sound source positions estimated by depth sensor and microphone array. / Iyama, Takahiro; Sugiyama, Osamu; Otsuka, Takuma et al.
IEEE International Conference on Intelligent Robots and Systems. Institute of Electrical and Electronics Engineers Inc., 2014. p. 1908-1913 6942814.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Iyama, T, Sugiyama, O, Otsuka, T, Itoyama, K & Okuno, HG 2014, Visualization of auditory awareness based on sound source positions estimated by depth sensor and microphone array. in IEEE International Conference on Intelligent Robots and Systems., 6942814, Institute of Electrical and Electronics Engineers Inc., pp. 1908-1913, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2014, Chicago, 14/9/14. https://doi.org/10.1109/IROS.2014.6942814

@inproceedings{004d7845b69c4c159e3258ca16c38cd8,

title = "Visualization of auditory awareness based on sound source positions estimated by depth sensor and microphone array",

abstract = "We have developed a system for visualizing auditory awareness on the basis of sound source locations estimated using a depth sensor and microphone array. Previous studies on visualizing the acoustic environment viewed the level of sound pressures directly on the captured image, so the visualization was often based on a mixture of several sound sources. As a result, which targets to focus on was not intuitive. To help users selectively to find the targets and focus on the target analysis, we should extract the captured acoustic information and selectively propose it with the user demand. We have designed a three-layer visualization model for auditory awareness consisting of a sound source distribution layer, a sound location layer, and a sound saliency layer. The model extracts acoustic information by using the depth image and multi-directional sound sources captured with a depth sensor and microphone array. This model is used in the system we developed for visualizing auditory awareness.",

author = "Takahiro Iyama and Osamu Sugiyama and Takuma Otsuka and Katsutoshi Itoyama and Okuno, {Hiroshi G.}",

year = "2014",

month = oct,

day = "31",

doi = "10.1109/IROS.2014.6942814",

language = "English",

isbn = "9781479969340",

pages = "1908--1913",

booktitle = "IEEE International Conference on Intelligent Robots and Systems",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

note = "2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2014 ; Conference date: 14-09-2014 Through 18-09-2014",

}

TY - GEN

T1 - Visualization of auditory awareness based on sound source positions estimated by depth sensor and microphone array

AU - Iyama, Takahiro

AU - Sugiyama, Osamu

AU - Otsuka, Takuma

AU - Itoyama, Katsutoshi

AU - Okuno, Hiroshi G.

PY - 2014/10/31

Y1 - 2014/10/31

N2 - We have developed a system for visualizing auditory awareness on the basis of sound source locations estimated using a depth sensor and microphone array. Previous studies on visualizing the acoustic environment viewed the level of sound pressures directly on the captured image, so the visualization was often based on a mixture of several sound sources. As a result, which targets to focus on was not intuitive. To help users selectively to find the targets and focus on the target analysis, we should extract the captured acoustic information and selectively propose it with the user demand. We have designed a three-layer visualization model for auditory awareness consisting of a sound source distribution layer, a sound location layer, and a sound saliency layer. The model extracts acoustic information by using the depth image and multi-directional sound sources captured with a depth sensor and microphone array. This model is used in the system we developed for visualizing auditory awareness.

AB - We have developed a system for visualizing auditory awareness on the basis of sound source locations estimated using a depth sensor and microphone array. Previous studies on visualizing the acoustic environment viewed the level of sound pressures directly on the captured image, so the visualization was often based on a mixture of several sound sources. As a result, which targets to focus on was not intuitive. To help users selectively to find the targets and focus on the target analysis, we should extract the captured acoustic information and selectively propose it with the user demand. We have designed a three-layer visualization model for auditory awareness consisting of a sound source distribution layer, a sound location layer, and a sound saliency layer. The model extracts acoustic information by using the depth image and multi-directional sound sources captured with a depth sensor and microphone array. This model is used in the system we developed for visualizing auditory awareness.

UR - http://www.scopus.com/inward/record.url?scp=84911497299&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84911497299&partnerID=8YFLogxK

U2 - 10.1109/IROS.2014.6942814

DO - 10.1109/IROS.2014.6942814

M3 - Conference contribution

AN - SCOPUS:84911497299

SN - 9781479969340

SP - 1908

EP - 1913

BT - IEEE International Conference on Intelligent Robots and Systems

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2014

Y2 - 14 September 2014 through 18 September 2014

ER -

Visualization of auditory awareness based on sound source positions estimated by depth sensor and microphone array

Abstract

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this