Multiple Senses Are Used in Speech Perception

Introduction

When someone speaks to you, do you see what they are saying? We tend to think of speech as being something we hear, but recent studies suggest that we use a variety of senses for speech perception - that the brain treats speech as something we hear, see and even feel.

Main Item

In a new report in Current Directions in Psychological Science, a journal of the Association for Psychological Science, psychologist Lawrence Rosenblum describes research examining how our different senses blend together to help us perceive speech.

We receive a lot of our speech information via visual cues, such as lip-reading, and this type of visual speech occurs throughout all cultures. And it is not just information from lips -  when someone is speaking to us, we will also note movements of the teeth, tongue and other non-mouth facial features.

It's likely that human speech perception has evolved to integrate many senses together. Put in another way, speech is not meant to be just heard, but also to be seen.

The McGurk Effect is a well-characterized example of the integration between what we see and what we hear when someone is speaking to us.

This phenomenon occurs when a sound (such as a syllable or word) is dubbed with a video showing a face making a different sound. For example, the audio may be playing "ba", while the face looks as though it is saying "va". When confronted with this, we will usually hear "va" or a combination of the two sounds, such as "da".

Interestingly, when study participants are aware of the dubbing or told to concentrate only on the audio, the McGurk Effect still occurs. Rosenblum suggests that this is evidence that once senses are integrated together, it is not possible to separate them.

Recent studies indicate that this integration occurs very early in the speech process, even before phonemes (the basic units of speech) are established.

Rosenblum suggests that physical movement of speech (that is, our mouths and lips moving) create acoustic and visual signals which have a similar form. He argues that as far as the speech brain is concerned, the auditory and visual information are never really separate. This could explain why we integrate speech so readily and in such a way that the audio and visual speech signals become indistinguishable from one another.

Rosenblum concludes that visual-speech research has a number of clinical implications, especially in the areas of autism, brain injury and schizophrenia and that "rehabilitation programs in each of these domains have incorporated visual-speech stimuli."

Related Information

• Motherese - The Sound of Baby Talk Across Languages: Mothers using motherese or baby talk plays important role in language learning, engaging child emotions and highlighting structure in language to help babies decode syllables and sentences.
• Sounds Help Autistic Kids Develop Speech and Gestures: Doctoral thesis in linguistics shows children with ASD can develop speech, gestures and sense of rhythm and melody by listening to various speech sounds.
• Children and Speech or Language Impairments: A speech or language impairment means an impairment of speech or sound production fluency voice or language.
• Famous People Who Have or Had Speech Differences or Stutter: A list of well known and famous people who have or had speech differences including stuttering during their lives.
• Autism Features A Unique Vocal Signature: Vocal analysis technology could change the study of language development as well as screening for autism spectrum disorders.
• Autistic Children Exhibit Three Unique Language Comprehension Profiles: A large study of language comprehension acquisition in children with autism reveals a more complex development process and advocates for new therapy approaches.

Attribution/Source(s):

This peer reviewed publication was selected for publishing by the editors of Disabled World due to its significant relevance to the disability community. Originally authored by Association for Psychological Science, and published on 2009/02/11 (Edit Update: 2024/06/17), the content may have been edited for style, clarity, or brevity. For further details or clarifications, Association for Psychological Science can be contacted at psychologicalscience.org. NOTE: Disabled World does not provide any warranties or endorsements related to this article.

▶ Share This Page

Page Information, Citing and Disclaimer

Disabled World is a comprehensive online resource that provides information and news related to disabilities, assistive technologies, and accessibility issues. Founded in 2004 our website covers a wide range of topics, including disability rights, healthcare, education, employment, and independent living, with the goal of supporting the disability community and their families.

Cite This Page (APA): Association for Psychological Science. (2009, February 11 - Last revised: 2024, June 17). Multiple Senses Are Used in Speech Perception. Disabled World. Retrieved October 15, 2024 from www.disabled-world.com/disability/types/hearing/communication/speech-reading.php

Permalink: <a href="https://www.disabled-world.com/disability/types/hearing/communication/speech-reading.php">Multiple Senses Are Used in Speech Perception</a>: Recent studies suggest that we use a variety of senses for speech perception in addition to lip reading.

Disabled World provides general information only. Materials presented are never meant to substitute for qualified medical care. Any 3rd party offering or advertising does not constitute an endorsement.