Noise Canceling AI Headphones Lets Wearers Choose Which Sounds They Hear

Author: University of Washington - Contact: washington.edu
Published: 2023/11/09 - Updated: 2023/11/10
Peer-Reviewed: Yes - Publication Type: Reports and Proceedings
On This Page: Summary - Main Article - About/Author

Synopsis: Using semantic hearing the headphones stream captured audio to a connected smartphone, which cancels unwanted environmental sounds. For example, someone might want to erase car horns when working indoors, but not when walking along busy streets. Yet people couldn't choose what sounds their headphones cancel. Tested in environments such as offices, streets and parks, the new system was able to extract sirens, bird chirps, alarms and other target sounds, while removing all other real-world noise.

advertisement

Noise-cancelling Headphones

Noise-cancelling headphones are a special type/kind of headphones which suppress unwanted ambient sounds. Noise-cancelling headphones can improve listening enough to completely offset the effect of a distracting concurrent activity.

There are two kinds of this noise cancellation: passive and active:

  • Active noise cancellation uses more advanced technology to actively counter noise by detecting and analyzing the sound pattern of incoming noise and then generating a mirror "anti-noise" signal to cancel it out. The end result is means you hear a drastically reduced level of noise.
  • Passive noise cancellation refers to noise cancellation achieved by the headset's physical features, like the design and type of materials used.

Noise-cancellation headphones have helped children with autism spectrum disorder (ASD) cope with behaviors related to hyper-reactivity and auditory stimuli - (2016 study from the Hong Kong Journal of Occupational Therapy).

Noise-cancellation headphones can also be used as sleeping aids, both passive isolating and active noise-cancellation headphones or earplugs help to achieve a reduction of ambient sounds, which is particularly helpful for people suffering from insomnia or other sleeping disorders.

Main Digest

Most anyone who's used noise-canceling headphones knows that hearing the right noise at the right time can be vital. Someone might want to erase car horns when working indoors, but not when walking along busy streets. Yet people can't choose what sounds their headphones cancel.

A team led by researchers at the University of Washington has developed deep-learning algorithms that let users pick which sounds filter through their headphones in real time. The team is calling the system "semantic hearing."

The headphones stream captured audio to a connected smartphone, which cancels all environmental sounds. Either through voice commands or a smartphone app, headphone wearers can select which sounds they want to include from 20 classes, such as sirens, baby cries, speech, vacuum cleaners and bird chirps. Only the selected sounds will be played through the headphones.

The team presented its findings Nov. 1 at UIST '23 in San Francisco. In the future, the researchers plan to release a commercial version of the system.

"Understanding what a bird sounds like and extracting it from all other sounds in an environment requires real-time intelligence that today's noise canceling headphones haven't achieved," said senior author Shyam Gollakota, a UW professor in the Paul G. Allen School of Computer Science & Engineering.

"The challenge is that the sounds headphone wearers hear need to sync with their visual senses. You can't be hearing someone's voice two seconds after they talk to you. This means the neural algorithms must process sounds in under a hundredth of a second."

Article continues below image.
Pictured is co-author Malek Itani demonstrating the noise canceling AI headphone system - Image Credit: University of Washington.
Pictured is co-author Malek Itani demonstrating the noise canceling AI headphone system - Image Credit: University of Washington.
Continued...

Because of this time crunch, the semantic hearing system must process sounds on a device such as a connected smartphone, instead of on more robust cloud servers. Additionally, because sounds from different directions arrive in people's ears at different times, the system must preserve these delays and other spatial cues so people can still meaningfully perceive sounds in their environment.

Tested in environments such as offices, streets and parks, the system was able to extract sirens, bird chirps, alarms and other target sounds, while removing all other real-world noise. When 22 participants rated the system's audio output for the target sound, they said that on average the quality improved compared to the original recording.

In some cases, the system struggled to distinguish between sounds that share many properties, such as vocal music and human speech. The researchers note that training the models on more real-world data might improve these outcomes.

Co-authors

Additional co-authors on the paper were:

Bandhav Veluri and Malek Itani, both UW doctoral students in the Allen School.

Justin Chan, who completed this research as a doctoral student in the Allen School and is now at Carnegie Mellon University.

Takuya Yoshioka, director of research at AssemblyAI.

Attribution/Source(s):

This peer reviewed article relating to our Hearing Aids and Devices section was selected for publishing by the editors of Disabled World due to its likely interest to our disability community readers. Though the content may have been edited for style, clarity, or length, the article "Noise Canceling AI Headphones Lets Wearers Choose Which Sounds They Hear" was originally written by University of Washington, and published by Disabled-World.com on 2023/11/09 (Updated: 2023/11/10). Should you require further information or clarification, University of Washington can be contacted at washington.edu. Disabled World makes no warranties or representations in connection therewith.

advertisement

Discover Related Topics

Share This Information To:
𝕏.com Facebook Reddit

Page Information, Citing and Disclaimer

Disabled World is an independent disability community founded in 2004 to provide disability news and information to people with disabilities, seniors, their family and/or carers. See our homepage for informative reviews, exclusive stories and how-tos. You can connect with us on social media such as X.com and our Facebook page.

Permalink: <a href="https://www.disabled-world.com/assistivedevices/hearing/semantic-hearing.php">Noise Canceling AI Headphones Lets Wearers Choose Which Sounds They Hear</a>

Cite This Page (APA): University of Washington. (2023, November 9). Noise Canceling AI Headphones Lets Wearers Choose Which Sounds They Hear. Disabled World. Retrieved December 5, 2023 from www.disabled-world.com/assistivedevices/hearing/semantic-hearing.php

Disabled World provides general information only. Materials presented are never meant to substitute for qualified professional medical care. Any 3rd party offering or advertising does not constitute an endorsement.