Sparse modeling of musical instruments sounds in time-frequency domain

Hiromu Ogi, Kohei Yatabe, Yasuhiro Oikawa, Yusuke Miyagi, Koji Oishi

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Sample-based synthesis is one of the most common synthesis methods of the digital synthesizer. It can synthesize musical instrument sounds well because it plays recorded sounds instead of generating sounds such as additive and frequency modulation syntheses. The recorded sounds are usually stored in the time domain. If the recorded sounds are stored in the time-frequency domain, sound processing can be simplified. Users can process audio signals intuitively by operating the time-frequency bins of the spectrograms. However, the representation of sounds in the time-frequency domain usually requires more memory than that in the time domain. In synthesizers, if much data is needed, hardware costs are increased correspondingly. Therefore, a technique to reduce the amount of data is required. In this paper, to reduce the amount of data, we introduce a sparse modeling technique for musical instrument sounds in the time-frequency domain. We propose an optimization algorithm of sparse modeling with four shrinkage operators. Numerical experiments show that the data quantity of the signals reduced by over 95 percent by using the technique.

Original languageEnglish
Title of host publicationProceedings of the 23rd International Congress on Acoustics
Subtitle of host publicationIntegrating 4th EAA Euroregio 2019
EditorsMartin Ochmann, Vorlander Michael, Janina Fels
PublisherInternational Commission for Acoustics (ICA)
Number of pages8
ISBN (Electronic)9783939296157
Publication statusPublished - 2019
Event23rd International Congress on Acoustics: Integrating 4th EAA Euroregio, ICA 2019 - Aachen, Germany
Duration: 2019 Sept 92019 Sept 23

Publication series

NameProceedings of the International Congress on Acoustics
ISSN (Print)2226-7808
ISSN (Electronic)2415-1599


Conference23rd International Congress on Acoustics: Integrating 4th EAA Euroregio, ICA 2019


  • Alternating direction methods of multipliers (ADMM)
  • Sample-based synthesis
  • Sparse modeling
  • Spectrogram

ASJC Scopus subject areas

  • Mechanical Engineering
  • Acoustics and Ultrasonics


Dive into the research topics of 'Sparse modeling of musical instruments sounds in time-frequency domain'. Together they form a unique fingerprint.

Cite this