Skip to main content

Human Brain Tunes Into Visual Rhythms In Sign Language

  • Synopsis: Published: 2017-06-09 - Study reveals that the brain entrains depending on the information in the signal - not on the differences between seeing and hearing - University of Chicago (uchicago.edu).

Main Document

Quote: "This study suggests that humans have the ability to follow perceptual rhythms and make temporal predictions in any of our senses."

The human brain works in rhythms and cycles. These patterns occur at predictable frequencies that depend on what a person is doing and on what part of the brain is active during the behavior.

Similarly, there are rhythms and patterns out in the world, and for the last 20 years, scientists have been perplexed by the brain's ability to "entrain," or match up, with these patterns. Language is one of those areas in which scientists observe neural entrainment: When people listen to speech, their brain waves lock up with the volume-based rhythms they hear. Since people can't pay attention to everything happening in their environment at once, this phase locking is thought to help anticipate when important information is likely to appear.

Many studies have documented this phenomenon in language processing; however, it has been difficult to tell whether neural entrainment is specialized for spoken language. In a new study in the Proceedings of the National Academy of Sciences, University of Chicago scholars designed an experiment using sign language to answer that question.

"To determine if neural entrainment to language is specialized for speech or if it is a general-purpose tool that humans can use for anything that is temporally predictable, we had to go outside of speech and outside of auditory perception," said Geoffrey Brookshire, the study's lead author and a PhD student in the Department of Psychology.

Brookshire worked with Daniel Casasanto, assistant professor of psychology and leader of the Experience and Cognition Lab; Susan Goldin-Meadow, the Beardsley Ruml Distinguished Service Professor of in the Department of Psychology and an acclaimed scholar of language and gesture; Howard Nusbaum, professor of psychology and an expert in spoken language and language use; and Jenny Lu, a PhD student specializing in sign language, gesture and language development.

"By looking at sign, we're learning something about how the brain processes language more generally. We're solving a mystery we couldn't crack by studying speech alone," Casasanto said.

In speech, the brain locks on to syllables, words and phrases, and those rhythms occur below 8 Hz, or 8 pulses per second. Vision also has a preferred frequency onto which it latches.

"When we focus on random flashes of light, for example, our brains most enthusiastically lock on to flashes around 10 Hz. By looking at sign language, we can ask whether the important thing for entrainment is which sense you're using, or the kind of information you're getting," Brookshire said.

To determine if people tune into visual rhythms in the same way they tune into the auditory rhythms of language, they showed videos of stories told in American Sign Language to fluent signers and measured brain activity as they watched. Once the researchers had these electroencephalogram readings, they needed a way to measure visual rhythms in sign language.

While there are well-established methods to measure rhythms in speech, there are no automatic, objective equivalents for the temporal structure of sign language. So the researchers created one.

They developed a new metric, called the instantaneous visual change, which summarizes the degree of change at each time period during signing. They ran experiment videos, the ones watched by participants, through their new algorithm to identify peaks and valleys in visual changes between frames. The largest peaks were associated with large, quick movements.

With this roadmap illustrating the magnitude of visual changes over time in the videos, Brookshire overlaid the participants' EEGs to see whether people entrain around the normal visual frequency of about 10 Hz, or at the lower frequencies of signs and phrases in sign language -- about 2 Hz.

Their discovery answers a fundamental question that has been lingering for years in research on speech entrainment: Is it specialized for auditory speech? The study reveals that the brain entrains depending on the information in the signal--not on the differences between seeing and hearing. Participants' brain waves locked into the specific frequencies of sign language, rather than locking into the higher frequency that vision tends to prefer.

"This is an exciting finding because scientists have been theorizing for years about how adaptable or flexible entrainment may be, but we were never sure if it was specific to auditory processing or if it was more general purpose," Brookshire said. "This study suggests that humans have the ability to follow perceptual rhythms and make temporal predictions in any of our senses."

In a broader sense, neuroscientists want to understand how the human brain creates and perceives language, and entrainment has emerged as an important mechanism. In revealing neural entrainment as a generalized strategy for improving sensitivity to informational peaks, this study takes significant steps toward advancing the understanding of human language and perception.

"The piece of the paper that I find particularly exciting is that it compares how signers and non-signers process American Sign Language stimuli," Goldin-Meadow said. "Although both groups showed the same level of entrainment in early visual regions, they displayed differences in frontal regions -- this finding sets the stage for us to identify aspects of neural entrainment that are linked to the physical properties of the visual signal compared to aspects that appear only with linguistic knowledge."

Related Information:

  1. Sign Language Comprehension Different for Right or Left-handed Signers - Study reveals the speed at which sign language users understand what others are signing depends on whether the conversation partners are left or right-handed - University of Birmingham
  2. Study on Intonation & Sign Language - Study finds ASL signers learn intonation in much the same way that users of spoken languages do - Linguistic Society of America
  3. Study Into How Children With Cochlear Implants Learn Words - Understanding how deaf infants with cochlear implants absorb information and learn novel words during interactions with parents to help improve parental guidance with language development - MediaSource


Information from our Deaf Communication: Sign Language & Hearing Aids section - (Full List).

Submit disability news, coming events, as well as assistive technology product news and reviews.


Loan Information for low income singles, families, seniors and disabled. Includes home, vehicle and personal loans.


Famous People with Disabilities - Well known people with disabilities and conditions who contributed to society.


List of awareness ribbon colors and their meaning. Also see our calendar of awareness dates.


Blood Pressure Chart - What should your blood pressure be, and information on blood group types/compatibility.





  1. New Peer-reviewed Journal 'Autism in Adulthood' Launching in 2019
  2. People Want to Live Longer - But Only If in Good Health
  3. Canada's Aging Population Signals Need for More Inclusive, Accessible Transportation System
  4. Britain's Unproductive Disabled: A Continuing Moral Panic?

Citation



Disclaimer: Content on Disabled World is not intended to be a substitute for professional medical advice, diagnosis, or treatment. Always seek the advice of a physician or other qualified health provider with any questions you may have regarding a medical condition. See our Terms of Service for more information.

Reporting Errors: Disabled World is an independent website, your assistance in reporting outdated or inaccurate information is appreciated. If you find an error please let us know.