Grabbing your ear: Rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment

Micah M. Murray, Sophie Molholm, Christoph M. Michel, Dirk J. Heslenfeld, Walter Ritter, Daniel C. Javitt, Charles E. Schroeder, John J. Foxe

Research output: Contribution to journalArticle

280 Citations (Scopus)

Abstract

Multisensory interactions are observed in species from single-cell organisms to humans. Important early work was primarily carried out in the cat superior colliculus and a set of critical parameters for their occurrence were defined. Primary among these were temporal synchrony and spatial alignment of bisensory inputs. Here, we assessed whether spatial alignment was also a critical parameter for the temporally earliest multisensory interactions that are observed in lower-level sensory cortices of the human. While multisensory interactions in humans have been shown behaviorally for spatially disparate stimuli (e.g. the ventriloquist effect), it is not clear if such effects are due to early sensory level integration or later perceptual level processing. In the present study, we used psychophysical and electrophysiological indices to show that auditory-somatosensory interactions in humans occur via the same early sensory mechanism both when stimuli are in and out of spatial register. Subjects more rapidly detected multisensory than unisensory events. At just 50 ms post-stimulus, neural responses to the multisensory 'whole' were greater than the summed responses from the constituent unisensory 'parts'. For all spatial configurations, this effect followed from a modulation of the strength of brain responses, rather than the activation of regions specifically responsive to multisensory pairs. Using the local auto-regressive average source estimation, we localized the initial auditory-somatosensory interactions to auditory association areas contralateral to the side of somatosensory stimulation. Thus, multisensory interactions can occur across wide peripersonal spatial separations remarkably early in sensory processing and in cortical regions traditionally considered unisensory.

Original languageEnglish (US)
Pages (from-to)963-974
Number of pages12
JournalCerebral Cortex
Volume15
Issue number7
DOIs
StatePublished - Jul 2005
Externally publishedYes

Fingerprint

Ear
Auditory Cortex
Superior Colliculi
Cats
Brain

Keywords

  • Area CM
  • Cross-modal
  • Event-related potential (ERP)
  • Human
  • Laura source estimation
  • Redundant signals effect (RSE)

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Grabbing your ear : Rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. / Murray, Micah M.; Molholm, Sophie; Michel, Christoph M.; Heslenfeld, Dirk J.; Ritter, Walter; Javitt, Daniel C.; Schroeder, Charles E.; Foxe, John J.

In: Cerebral Cortex, Vol. 15, No. 7, 07.2005, p. 963-974.

Research output: Contribution to journalArticle

Murray, Micah M. ; Molholm, Sophie ; Michel, Christoph M. ; Heslenfeld, Dirk J. ; Ritter, Walter ; Javitt, Daniel C. ; Schroeder, Charles E. ; Foxe, John J. / Grabbing your ear : Rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. In: Cerebral Cortex. 2005 ; Vol. 15, No. 7. pp. 963-974.
@article{370e151203124fb8b5e5ea2527203923,
title = "Grabbing your ear: Rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment",
abstract = "Multisensory interactions are observed in species from single-cell organisms to humans. Important early work was primarily carried out in the cat superior colliculus and a set of critical parameters for their occurrence were defined. Primary among these were temporal synchrony and spatial alignment of bisensory inputs. Here, we assessed whether spatial alignment was also a critical parameter for the temporally earliest multisensory interactions that are observed in lower-level sensory cortices of the human. While multisensory interactions in humans have been shown behaviorally for spatially disparate stimuli (e.g. the ventriloquist effect), it is not clear if such effects are due to early sensory level integration or later perceptual level processing. In the present study, we used psychophysical and electrophysiological indices to show that auditory-somatosensory interactions in humans occur via the same early sensory mechanism both when stimuli are in and out of spatial register. Subjects more rapidly detected multisensory than unisensory events. At just 50 ms post-stimulus, neural responses to the multisensory 'whole' were greater than the summed responses from the constituent unisensory 'parts'. For all spatial configurations, this effect followed from a modulation of the strength of brain responses, rather than the activation of regions specifically responsive to multisensory pairs. Using the local auto-regressive average source estimation, we localized the initial auditory-somatosensory interactions to auditory association areas contralateral to the side of somatosensory stimulation. Thus, multisensory interactions can occur across wide peripersonal spatial separations remarkably early in sensory processing and in cortical regions traditionally considered unisensory.",
keywords = "Area CM, Cross-modal, Event-related potential (ERP), Human, Laura source estimation, Redundant signals effect (RSE)",
author = "Murray, {Micah M.} and Sophie Molholm and Michel, {Christoph M.} and Heslenfeld, {Dirk J.} and Walter Ritter and Javitt, {Daniel C.} and Schroeder, {Charles E.} and Foxe, {John J.}",
year = "2005",
month = "7",
doi = "10.1093/cercor/bhh197",
language = "English (US)",
volume = "15",
pages = "963--974",
journal = "Cerebral Cortex",
issn = "1047-3211",
publisher = "Oxford University Press",
number = "7",

}

TY - JOUR

T1 - Grabbing your ear

T2 - Rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment

AU - Murray, Micah M.

AU - Molholm, Sophie

AU - Michel, Christoph M.

AU - Heslenfeld, Dirk J.

AU - Ritter, Walter

AU - Javitt, Daniel C.

AU - Schroeder, Charles E.

AU - Foxe, John J.

PY - 2005/7

Y1 - 2005/7

N2 - Multisensory interactions are observed in species from single-cell organisms to humans. Important early work was primarily carried out in the cat superior colliculus and a set of critical parameters for their occurrence were defined. Primary among these were temporal synchrony and spatial alignment of bisensory inputs. Here, we assessed whether spatial alignment was also a critical parameter for the temporally earliest multisensory interactions that are observed in lower-level sensory cortices of the human. While multisensory interactions in humans have been shown behaviorally for spatially disparate stimuli (e.g. the ventriloquist effect), it is not clear if such effects are due to early sensory level integration or later perceptual level processing. In the present study, we used psychophysical and electrophysiological indices to show that auditory-somatosensory interactions in humans occur via the same early sensory mechanism both when stimuli are in and out of spatial register. Subjects more rapidly detected multisensory than unisensory events. At just 50 ms post-stimulus, neural responses to the multisensory 'whole' were greater than the summed responses from the constituent unisensory 'parts'. For all spatial configurations, this effect followed from a modulation of the strength of brain responses, rather than the activation of regions specifically responsive to multisensory pairs. Using the local auto-regressive average source estimation, we localized the initial auditory-somatosensory interactions to auditory association areas contralateral to the side of somatosensory stimulation. Thus, multisensory interactions can occur across wide peripersonal spatial separations remarkably early in sensory processing and in cortical regions traditionally considered unisensory.

AB - Multisensory interactions are observed in species from single-cell organisms to humans. Important early work was primarily carried out in the cat superior colliculus and a set of critical parameters for their occurrence were defined. Primary among these were temporal synchrony and spatial alignment of bisensory inputs. Here, we assessed whether spatial alignment was also a critical parameter for the temporally earliest multisensory interactions that are observed in lower-level sensory cortices of the human. While multisensory interactions in humans have been shown behaviorally for spatially disparate stimuli (e.g. the ventriloquist effect), it is not clear if such effects are due to early sensory level integration or later perceptual level processing. In the present study, we used psychophysical and electrophysiological indices to show that auditory-somatosensory interactions in humans occur via the same early sensory mechanism both when stimuli are in and out of spatial register. Subjects more rapidly detected multisensory than unisensory events. At just 50 ms post-stimulus, neural responses to the multisensory 'whole' were greater than the summed responses from the constituent unisensory 'parts'. For all spatial configurations, this effect followed from a modulation of the strength of brain responses, rather than the activation of regions specifically responsive to multisensory pairs. Using the local auto-regressive average source estimation, we localized the initial auditory-somatosensory interactions to auditory association areas contralateral to the side of somatosensory stimulation. Thus, multisensory interactions can occur across wide peripersonal spatial separations remarkably early in sensory processing and in cortical regions traditionally considered unisensory.

KW - Area CM

KW - Cross-modal

KW - Event-related potential (ERP)

KW - Human

KW - Laura source estimation

KW - Redundant signals effect (RSE)

UR - http://www.scopus.com/inward/record.url?scp=20544460923&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=20544460923&partnerID=8YFLogxK

U2 - 10.1093/cercor/bhh197

DO - 10.1093/cercor/bhh197

M3 - Article

C2 - 15537674

AN - SCOPUS:20544460923

VL - 15

SP - 963

EP - 974

JO - Cerebral Cortex

JF - Cerebral Cortex

SN - 1047-3211

IS - 7

ER -