Monaural Hearing: Understanding Sound Direction

Estimating 3D Direction of Sound Arrival Based on Monaural Modulation Spectrum

Published: 2023-03-15 - Updated: 2023-03-16
Author: Japan Advanced Institute of Science and Technology | Contact: jaist.ac.jp/english/
Peer-Reviewed Publication: Yes
Journal Reference: DOI Link to the Study Paper
Library of Related Papers: Deafness and Hearing Loss Publications

Synopsis: Researchers propose a method for sound localization based on frequency modulation of the received signal in individuals possessing monoaural hearing. The human ear's ability to locate sounds in the surrounding environment is remarkable. Typically, people with good hearing use both ears to detect and interpret auditory cues. However, studies have suggested that while binaural cues are sufficient for sound localization, they are unnecessary. People with monaural hearing (hearing loss in one ear) can also perceive sound location.

Definition

Monaural Hearing: Monaural hearing creates a feeling of sound being heard in one ear. Binaural hearing gives a feeling of balanced reception of sounds, also known as stereo-effect. Humans naturally have what's known as binaural hearing, which is the ability to hear in two ears. However, individuals sometimes experience hearing loss in one ear, known as unilateral hearing loss. As the name indicates, it means that there is hearing loss, or sometimes complete deafness in only one ear, which results in monaural hearing.

Main Digest

Method of Estimating Three-Dimensional Direction of Arrival Based on Monaural Modulation Spectrum - Applied Acoustics.

The ability to locate sounds in the surrounding environment is a remarkable feature of the human ear. Typically, people with good hearing use both ears to detect and interpret auditory cues. Differences in the loudness or arrival time of sounds at each ear provide us with vital information about the location and direction of the sound source. Interestingly, however, studies have suggested that while binaural cues are sufficient for sound localization, they are unnecessary. People with monaural hearing (hearing loss in one ear) can perceive sound location as well.

Related Publications:

Fortunately for engineers, this can help remove limitations on the design and positioning of audio recording devices and microphone arrays. For source localization and noise reduction, microphone arrays must be placed at specific intervals and positions to capture and analyze sound from different directions effectively. To avoid poor sound quality resulting from inadequate microphone array design or positioning, the capability to estimate the proper direction using monaural cues is highly desirable as it can help simplify microphone array designs.

(Article continues below image.)

Researchers from Japan propose a method for estimating sound direction from monaural hearing that takes into consideration how an individual’s head, torso, and ears affect their perception of the sound source - Image Credit: Masashi Unoki from JAIST.

(Continued...)

In a study made available online on 13th January 2023 and published in the journal Applied Acoustics on 28th February 2023, Prof. Masashi Unoki and his colleagues from the Japan Advanced Institute of Science and Technology (JAIST) and Toyama Prefectural University, Japan, have proposed a method that uses monaural cues to estimate the direction-of-arrival (DOA) of sound signals in three dimensions.

"In our work, we propose an estimation method based on monaural modulation spectrum (MMS), which relies on modulation in the frequency spectrum of the received signal to detect the signal DOA. This can help us develop monaural cues for single-channel signal processing," explains Prof. Unoki.

To determine the monaural DOA, the team simulated sound signals from different directions using artificial amplitude modulation noise and human speech signals while accounting for the effect of the ears, torso, and head in filtering sound. Next, they obtained the MMS of the signals describing their frequency modulations to identify key features that could be tied to the DOA of the signals. To avoid monaural front-back confusion, which occurs when sound sources at the same angle in front of or behind the listener can produce the same estimates for the DOA, the researchers considered the effect of head movement on the MMS to realize a more accurate DOA estimation.

(Article continues below image.)

The proposed model is trained to estimate the DOA of sound signals based on the extracted features of the monaural modulation spectrum of the signal - Image Credit: Masashi Unoki from JAIST.

(Continued...)

Using the known DOA and the features of the MMS as training data, they then constructed a polynomial regression model that estimated the DOA from the MMS features of the sound signal in terms of the horizontal and the vertical direction of the listener. The model could accurately estimate the DOA of 829,440 speech signals, outperforming even human monaural hearing.

While the team qualifies their findings by suggesting that there is more work to be done to account for background noise and individual differences in ear shape when creating the model, the study demonstrates an impressive advancement in monaural sound localization. Speculating about its implications, the researchers envision their technology's applications in sound surveillance techniques and hearing aid enhancements.

"Our study will help reveal our ability to localize sounds based on monaural hearing, which, in turn, could stimulate various innovations in hearing aid techniques in the long-term," concludes Prof. Unoki.

About the Study

This study was supported by the Fund for the Promotion of Joint International Research (Fostering Joint International Research (B)) (20KK0233) and JSPS-NSFC Bilateral Joint Research Projects/Seminars (JSJSBP120197416). This study was also supported by the SCOPE Program of the Ministry of Internal Affairs and Communications (Grant No.: 201605002). Authors: Rui Wang, Nguyen Khanh Bui, Daisuke Morikawa, and Masashi Unoki.

Attribution/Source(s):

This peer reviewed article relating to our deafness and hearing loss section was selected for publishing by the editors of Disabled World due to its likely interest to our disability community readers. Though the content may have been edited for style, clarity, or length, the article "Monaural Hearing: Understanding Sound Direction" was originally written by Japan Advanced Institute of Science and Technology. Should you require further information or clarification, they can be contacted at jaist.ac.jp/english/ Disabled World makes no warranties or representations in connection therewith.

Tweet This Add to Facebook Post to Reddit