Unlocking the Secrets: Scientists Decode the Silent Conversation Between Your Eyes and Ears

Parametric Information Regarding Eye Movement is Sent to the Ears

Author: Duke University
Published: 2023/11/22 - Updated: 2023/11/23
Publication Type: Experimental Study - Peer-Reviewed: N/A
Contents: Summary - Main - Related Publications

Synopsis: Eye movements can be decoded by the sounds they generate in the ear, meaning your hearing may be affected by vision.. Researchers discover the ears make a subtle, imperceptible noise when the eyes move and show that these sounds can reveal where your eyes are looking. It also works the other way around. Just by knowing where someone is looking, they were able to predict what the waveform of the subtle ear sound would look like.

Main Digest

"Parametric Information About Eye Movements is Sent to the Ears" - Proceedings of the National Academy of Sciences.

Scientists can now pinpoint where someone's eyes are looking just by listening to their ears.

"You can actually estimate the movement of the eyes, the position of the target that the eyes are going to look at, just from recordings made with a microphone in the ear canal," said Jennifer Groh, Ph.D., senior author of the new report, and a professor in the departments of psychology & neuroscience as well as neurobiology at Duke University.

In 2018, Groh's team discovered that the ears make a subtle, imperceptible noise when the eyes move. In a new report appearing the week of November 20 in the journal Proceedings of the National Academy of Sciences, the Duke team now shows that these sounds can reveal where your eyes are looking.

It also works the other way around. Just by knowing where someone is looking, Groh and her team were able to predict what the waveform of the subtle ear sound would look like.

These sounds, Groh believes, may be caused when eye movements stimulate the brain to contract either middle ear muscles, which typically help dampen loud sounds, or the hair cells that help amplify quiet sounds.

The exact purpose of these ear squeaks is unclear, but Groh's initial hunch is that it might help sharpen people's perception.

"We think this is part of a system for allowing the brain to match up where sights and sounds are located, even though our eyes can move when our head and ears do not," Groh said.

Understanding the relationship between subtle ear sounds and vision might lead to the development of new clinical tests for hearing.

"If each part of the ear contributes individual rules for the eardrum signal, then they could be used as a type of clinical tool to assess which part of the anatomy in the ear is malfunctioning," said Stephanie Lovich, one of the lead authors of the paper and a graduate student in psychology & neuroscience at Duke.

Just as the eye's pupils constrict or dilate like a camera's aperture to adjust how much light gets in, the ears too have their own way to regulate hearing. Scientists long thought that these sound-regulating mechanisms only helped to amplify soft sounds or dampen loud ones. But in 2018, Groh and her team discovered that these same sound-regulating mechanisms were also activated by eye movements, suggesting that the brain informs the ears about the eye's movements.

Continued below image.
Image shows researchers from Duke who helped lead the project (from left to right): Cynthia King, Jennifer Groh, Stephanie Lovich, and David Murphy - Image Credit: Meredith Schmehl/Duke University.
Image shows researchers from Duke who helped lead the project (from left to right): Cynthia King, Jennifer Groh, Stephanie Lovich, and David Murphy - Image Credit: Meredith Schmehl/Duke University.
Continued...

In their latest study, the research team followed up on their initial discovery and investigated whether the faint auditory signals contained detailed information about the eye movements.

To decode people's ear sounds, Groh's team at Duke and Professor Christopher Shera, Ph.D. from the University of Southern California, recruited 16 adults with unimpaired vision and hearing to Groh's lab in Durham to take a fairly simple eye test.

Participants looked at a static green dot on a computer screen, then, without moving their heads, tracked the dot with their eyes as it disappeared and then reappeared either up, down, left, right, or diagonal from the starting point. This gave Groh's team a wide-range of auditory signals generated as the eyes moved horizontally, vertically, or diagonally.

Continued below image.
A woman tracks a green dot on a screen while researchers listen to the sounds made in her ear canals using microphone embedded earbuds - Image Credit: Meredith Schmehl/Duke University.
A woman tracks a green dot on a screen while researchers listen to the sounds made in her ear canals using microphone embedded earbuds - Image Credit: Meredith Schmehl/Duke University.
Continued...

An eye tracker recorded where participant's pupils were darting to compare against the ear sounds, which were captured using a microphone-embedded pair of earbuds.

The research team analyzed the ear sounds and found unique signatures for different directions of movement. This enabled them to crack the ear sound's code and calculate where people were looking just by scrutinizing a soundwave.

"Since a diagonal eye movement is just a horizontal component and vertical component, my labmate and co-author David Murphy realized you can take those two components and guess what they would be if you put them together," Lovich said. "Then you can go in the opposite direction and look at an oscillation to predict that someone was looking 30 degrees to the left."

Groh is now starting to examine whether these ear sounds play a role in perception.

One set of projects is focused on how eye-movement ear sounds may be different in people with hearing or vision loss.

Groh is also testing whether people who don't have hearing or vision loss will generate ear signals that can predict how well they do on a sound localization task, like spotting where an ambulance is while driving, which relies on mapping auditory information onto a visual scene.

"Some folks have a really reproducible signal day-to-day, and you can measure it quickly," Groh said. "You might expect those folks to be really good at a visual-auditory task compared to other folks, where it's more variable."

Groh's research was supported by a grant from the National Institutes of Health (NIDCD DC017532).

Citation:

"Parametric Information About Eye Movements is Sent to the Ears," Stephanie N. Lovich, Cynthia D. King, David L.K. Murphy, Rachel Landrum, Christopher A. Shera, Jennifer M. Groh. Proceedings of the National Academy of Sciences, Nov. 2023.

Attribution/Source(s):

This quality-reviewed publication pertaining to our Medical Research and News section was selected for circulation by the editors of Disabled World due to its likely interest to our disability community readers. Though the content may have been edited for style, clarity, or length, the article "Unlocking the Secrets: Scientists Decode the Silent Conversation Between Your Eyes and Ears" was originally written by Duke University, and submitted for publishing on 2023/11/22 (Edit Update: 2023/11/23). Should you require further information or clarification, Duke University can be contacted at the duke.edu website. Disabled World makes no warranties or representations in connection therewith.

📢 Discover Related Topics


👍 Share This Information To:
𝕏.com Facebook Reddit

Page Information, Citing and Disclaimer

Disabled World is an independent disability community founded in 2004 to provide disability news and information to people with disabilities, seniors, their family and/or carers. See our homepage for informative reviews, exclusive stories and how-tos. You can connect with us on social media such as X.com and our Facebook page.

Permalink: <a href="https://www.disabled-world.com/medical/eyes-ears.php">Unlocking the Secrets: Scientists Decode the Silent Conversation Between Your Eyes and Ears</a>

Cite This Page (APA): Duke University. (2023, November 22). Unlocking the Secrets: Scientists Decode the Silent Conversation Between Your Eyes and Ears. Disabled World. Retrieved February 26, 2024 from www.disabled-world.com/medical/eyes-ears.php

Disabled World provides general information only. Materials presented are never meant to substitute for qualified professional medical care. Any 3rd party offering or advertising does not constitute an endorsement.