Monaural Hearing: Understanding Sound Direction
Author: Japan Advanced Institute of Science and Technology
Published: 2023/03/15 - Updated: 2023/03/16
Peer Reviewed Publication: Yes
Topic: Deafness and Hearing Loss - Publications List
Page Content: Synopsis - Introduction - Main
Synopsis: Researchers propose a method for sound localization based on frequency modulation of the received signal in individuals possessing monoaural hearing. The human ear's ability to locate sounds in the surrounding environment is remarkable. Typically, people with good hearing use both ears to detect and interpret auditory cues.
Introduction
Method of Estimating Three-Dimensional Direction of Arrival Based on Monaural Modulation Spectrum - Applied Acoustics.
The ability to locate sounds in the surrounding environment is a remarkable feature of the human ear. Typically, people with good hearing use both ears to detect and interpret auditory cues. Differences in the loudness or arrival time of sounds at each ear provide us with vital information about the location and direction of the sound source. Interestingly, however, studies have suggested that while binaural cues are sufficient for sound localization, they are unnecessary. People with monaural hearing (hearing loss in one ear) can perceive sound location as well.
Focus
Fortunately for engineers, this can help remove limitations on the design and positioning of audio recording devices and microphone arrays. For source localization and noise reduction, microphone arrays must be placed at specific intervals and positions to capture and analyze sound from different directions effectively. To avoid poor sound quality resulting from inadequate microphone array design or positioning, the capability to estimate the proper direction using monaural cues is highly desirable as it can help simplify microphone array designs.
In a study made available online on 13th January 2023 and published in the journal Applied Acoustics on 28th February 2023, Prof. Masashi Unoki and his colleagues from the Japan Advanced Institute of Science and Technology (JAIST) and Toyama Prefectural University, Japan, have proposed a method that uses monaural cues to estimate the direction-of-arrival (DOA) of sound signals in three dimensions.
"In our work, we propose an estimation method based on monaural modulation spectrum (MMS), which relies on modulation in the frequency spectrum of the received signal to detect the signal DOA. This can help us develop monaural cues for single-channel signal processing," explains Prof. Unoki.
To determine the monaural DOA, the team simulated sound signals from different directions using artificial amplitude modulation noise and human speech signals while accounting for the effect of the ears, torso, and head in filtering sound. Next, they obtained the MMS of the signals describing their frequency modulations to identify key features that could be tied to the DOA of the signals. To avoid monaural front-back confusion, which occurs when sound sources at the same angle in front of or behind the listener can produce the same estimates for the DOA, the researchers considered the effect of head movement on the MMS to realize a more accurate DOA estimation.
Using the known DOA and the features of the MMS as training data, they then constructed a polynomial regression model that estimated the DOA from the MMS features of the sound signal in terms of the horizontal and the vertical direction of the listener. The model could accurately estimate the DOA of 829,440 speech signals, outperforming even human monaural hearing.
While the team qualifies their findings by suggesting that there is more work to be done to account for background noise and individual differences in ear shape when creating the model, the study demonstrates an impressive advancement in monaural sound localization. Speculating about its implications, the researchers envision their technology's applications in sound surveillance techniques and hearing aid enhancements.
"Our study will help reveal our ability to localize sounds based on monaural hearing, which, in turn, could stimulate various innovations in hearing aid techniques in the long-term," concludes Prof. Unoki.
About the Study
This study was supported by the Fund for the Promotion of Joint International Research (Fostering Joint International Research (B)) (20KK0233) and JSPS-NSFC Bilateral Joint Research Projects/Seminars (JSJSBP120197416). This study was also supported by the SCOPE Program of the Ministry of Internal Affairs and Communications (Grant No.: 201605002). Authors: Rui Wang, Nguyen Khanh Bui, Daisuke Morikawa, and Masashi Unoki.
Attribution/Source(s): This peer reviewed publication was selected for publishing by the editors of Disabled World (DW) due to its relevance to the disability community. Originally authored by Japan Advanced Institute of Science and Technology and published on 2023/03/15, this content may have been edited for style, clarity, or brevity. For further details or clarifications, Japan Advanced Institute of Science and Technology can be contacted at jaist.ac.jp/english/ NOTE: Disabled World does not provide any warranties or endorsements related to this article.