Impaired multisensory processing in schizophrenia: Deficits in the visual enhancement of speech comprehension under noisy environmental conditions

Lars A. Ross, Dave Saint-Amour, Victoria M. Leavitt, Sophie Molholm, Daniel C. Javitt, John J. Foxe

Research output: Contribution to journalArticle

112 Citations (Scopus)

Abstract

Background: Viewing a speaker's articulatory movements substantially improves a listener's ability to understand spoken words, especially under noisy environmental conditions. In this study we investigated the ability of patients with schizophrenia to integrate visual and auditory speech. Our objective was to determine to what extent they experience benefit from visual articulation and to detail under what listening conditions they might show the greatest impairments. Methods: We assessed the ability to recognize auditory and audiovisual speech in different levels of noise in 18 patients with schizophrenia and compared their performance with that of 18 healthy volunteers. We used a large set of monosyllabic words as our stimuli in order to more closely approximate performance in everyday situations. Results: Patients with schizophrenia showed deficits in their ability to derive benefit from visual articulatory motion. This impairment was most pronounced at signal-to-noise levels where multisensory gain is known to be maximal in healthy control subjects. A surprising finding was that despite known early auditory sensory processing deficits and reports of impairments in speech processing in schizophrenia, patients' performance in unisensory auditory speech perception remained fully intact. Conclusions: Thus, the results showed a specific deficit in multisensory speech processing in the absence of any measurable deficit in unisensory speech processing and suggest that sensory integration dysfunction may be an important and, to date, rather overlooked aspect of schizophrenia.

Original languageEnglish (US)
Pages (from-to)173-183
Number of pages11
JournalSchizophrenia Research
Volume97
Issue number1-3
DOIs
StatePublished - Dec 2007
Externally publishedYes

Fingerprint

Aptitude
Schizophrenia
Noise
Healthy Volunteers
Auditory Perception
Speech Perception

Keywords

  • Audiovisual
  • Crossmodal
  • Multisensory
  • Schizophrenia
  • Sensory integration
  • Speech

ASJC Scopus subject areas

  • Psychiatry and Mental health
  • Behavioral Neuroscience
  • Biological Psychiatry
  • Neurology
  • Psychology(all)

Cite this

Impaired multisensory processing in schizophrenia : Deficits in the visual enhancement of speech comprehension under noisy environmental conditions. / Ross, Lars A.; Saint-Amour, Dave; Leavitt, Victoria M.; Molholm, Sophie; Javitt, Daniel C.; Foxe, John J.

In: Schizophrenia Research, Vol. 97, No. 1-3, 12.2007, p. 173-183.

Research output: Contribution to journalArticle

Ross, Lars A. ; Saint-Amour, Dave ; Leavitt, Victoria M. ; Molholm, Sophie ; Javitt, Daniel C. ; Foxe, John J. / Impaired multisensory processing in schizophrenia : Deficits in the visual enhancement of speech comprehension under noisy environmental conditions. In: Schizophrenia Research. 2007 ; Vol. 97, No. 1-3. pp. 173-183.
@article{ecb54b8e90ad46b298f7f9a364d44c9c,
title = "Impaired multisensory processing in schizophrenia: Deficits in the visual enhancement of speech comprehension under noisy environmental conditions",
abstract = "Background: Viewing a speaker's articulatory movements substantially improves a listener's ability to understand spoken words, especially under noisy environmental conditions. In this study we investigated the ability of patients with schizophrenia to integrate visual and auditory speech. Our objective was to determine to what extent they experience benefit from visual articulation and to detail under what listening conditions they might show the greatest impairments. Methods: We assessed the ability to recognize auditory and audiovisual speech in different levels of noise in 18 patients with schizophrenia and compared their performance with that of 18 healthy volunteers. We used a large set of monosyllabic words as our stimuli in order to more closely approximate performance in everyday situations. Results: Patients with schizophrenia showed deficits in their ability to derive benefit from visual articulatory motion. This impairment was most pronounced at signal-to-noise levels where multisensory gain is known to be maximal in healthy control subjects. A surprising finding was that despite known early auditory sensory processing deficits and reports of impairments in speech processing in schizophrenia, patients' performance in unisensory auditory speech perception remained fully intact. Conclusions: Thus, the results showed a specific deficit in multisensory speech processing in the absence of any measurable deficit in unisensory speech processing and suggest that sensory integration dysfunction may be an important and, to date, rather overlooked aspect of schizophrenia.",
keywords = "Audiovisual, Crossmodal, Multisensory, Schizophrenia, Sensory integration, Speech",
author = "Ross, {Lars A.} and Dave Saint-Amour and Leavitt, {Victoria M.} and Sophie Molholm and Javitt, {Daniel C.} and Foxe, {John J.}",
year = "2007",
month = "12",
doi = "10.1016/j.schres.2007.08.008",
language = "English (US)",
volume = "97",
pages = "173--183",
journal = "Schizophrenia Research",
issn = "0920-9964",
publisher = "Elsevier",
number = "1-3",

}

TY - JOUR

T1 - Impaired multisensory processing in schizophrenia

T2 - Deficits in the visual enhancement of speech comprehension under noisy environmental conditions

AU - Ross, Lars A.

AU - Saint-Amour, Dave

AU - Leavitt, Victoria M.

AU - Molholm, Sophie

AU - Javitt, Daniel C.

AU - Foxe, John J.

PY - 2007/12

Y1 - 2007/12

N2 - Background: Viewing a speaker's articulatory movements substantially improves a listener's ability to understand spoken words, especially under noisy environmental conditions. In this study we investigated the ability of patients with schizophrenia to integrate visual and auditory speech. Our objective was to determine to what extent they experience benefit from visual articulation and to detail under what listening conditions they might show the greatest impairments. Methods: We assessed the ability to recognize auditory and audiovisual speech in different levels of noise in 18 patients with schizophrenia and compared their performance with that of 18 healthy volunteers. We used a large set of monosyllabic words as our stimuli in order to more closely approximate performance in everyday situations. Results: Patients with schizophrenia showed deficits in their ability to derive benefit from visual articulatory motion. This impairment was most pronounced at signal-to-noise levels where multisensory gain is known to be maximal in healthy control subjects. A surprising finding was that despite known early auditory sensory processing deficits and reports of impairments in speech processing in schizophrenia, patients' performance in unisensory auditory speech perception remained fully intact. Conclusions: Thus, the results showed a specific deficit in multisensory speech processing in the absence of any measurable deficit in unisensory speech processing and suggest that sensory integration dysfunction may be an important and, to date, rather overlooked aspect of schizophrenia.

AB - Background: Viewing a speaker's articulatory movements substantially improves a listener's ability to understand spoken words, especially under noisy environmental conditions. In this study we investigated the ability of patients with schizophrenia to integrate visual and auditory speech. Our objective was to determine to what extent they experience benefit from visual articulation and to detail under what listening conditions they might show the greatest impairments. Methods: We assessed the ability to recognize auditory and audiovisual speech in different levels of noise in 18 patients with schizophrenia and compared their performance with that of 18 healthy volunteers. We used a large set of monosyllabic words as our stimuli in order to more closely approximate performance in everyday situations. Results: Patients with schizophrenia showed deficits in their ability to derive benefit from visual articulatory motion. This impairment was most pronounced at signal-to-noise levels where multisensory gain is known to be maximal in healthy control subjects. A surprising finding was that despite known early auditory sensory processing deficits and reports of impairments in speech processing in schizophrenia, patients' performance in unisensory auditory speech perception remained fully intact. Conclusions: Thus, the results showed a specific deficit in multisensory speech processing in the absence of any measurable deficit in unisensory speech processing and suggest that sensory integration dysfunction may be an important and, to date, rather overlooked aspect of schizophrenia.

KW - Audiovisual

KW - Crossmodal

KW - Multisensory

KW - Schizophrenia

KW - Sensory integration

KW - Speech

UR - http://www.scopus.com/inward/record.url?scp=36048970381&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=36048970381&partnerID=8YFLogxK

U2 - 10.1016/j.schres.2007.08.008

DO - 10.1016/j.schres.2007.08.008

M3 - Article

C2 - 17928202

AN - SCOPUS:36048970381

VL - 97

SP - 173

EP - 183

JO - Schizophrenia Research

JF - Schizophrenia Research

SN - 0920-9964

IS - 1-3

ER -