The case for feedforward multisensory convergence during early cortical processing

John J. Foxe, Charles E. Schroeder

Research output: Contribution to journalArticle

217 Citations (Scopus)

Abstract

The prevailing hierarchical model of sensory processing in the brain holds that different modalities of sensory information emanating from a single object are analyzed extensively during passage through their respective unisensory processing streams before they are combined in higher-order 'multisensory' regions of the cortex. Because of this view, multisensory interactions that have been found at early, putatively 'unisensory' cortical processing stages during hemodynamic imaging studies have been assumed to reflect feedback modulations that occur subsequent to multisensory processing in the higher-order multisensory areas. In this paper, we consider findings that challenge an exclusively feedback interpretation of early multisensory integration effects. First, high-density electrical mapping studies in humans have shown that multisensory convergence and integration effects can occur so early in the time course of sensory processing that purely feedback mediation becomes extremely unlikely. Second, direct neural recordings in monkeys show that, in some cases, convergent inputs at early cortical stages have physiological profiles characteristic of feedforward rather than feedback inputs. Third, damage to higher-order integrative regions in humans often spares the ability to integrate across sensory modalities. Finally, recent anatomic tracer studies have reported direct anatomical connections between primary visual and auditory cortex. These findings make it clear that multisensory convergence at early stages of cortical processing results from feedforward as well as feedback and lateral connections, thus using the full range of anatomical connections available in brain circuitry.

Original languageEnglish (US)
Pages (from-to)419-423
Number of pages5
JournalNeuroReport
Volume16
Issue number5
DOIs
StatePublished - Apr 4 2005
Externally publishedYes

Fingerprint

Auditory Cortex
Brain
Visual Cortex
Haplorhini
Hemodynamics

Keywords

  • Auditory cortex
  • Binding
  • Caudo-medial belt
  • Crossmodal integration
  • Multisensory integration
  • Sensory integration

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

The case for feedforward multisensory convergence during early cortical processing. / Foxe, John J.; Schroeder, Charles E.

In: NeuroReport, Vol. 16, No. 5, 04.04.2005, p. 419-423.

Research output: Contribution to journalArticle

Foxe, John J. ; Schroeder, Charles E. / The case for feedforward multisensory convergence during early cortical processing. In: NeuroReport. 2005 ; Vol. 16, No. 5. pp. 419-423.
@article{7196a35cc2054335a7923b036f26927a,
title = "The case for feedforward multisensory convergence during early cortical processing",
abstract = "The prevailing hierarchical model of sensory processing in the brain holds that different modalities of sensory information emanating from a single object are analyzed extensively during passage through their respective unisensory processing streams before they are combined in higher-order 'multisensory' regions of the cortex. Because of this view, multisensory interactions that have been found at early, putatively 'unisensory' cortical processing stages during hemodynamic imaging studies have been assumed to reflect feedback modulations that occur subsequent to multisensory processing in the higher-order multisensory areas. In this paper, we consider findings that challenge an exclusively feedback interpretation of early multisensory integration effects. First, high-density electrical mapping studies in humans have shown that multisensory convergence and integration effects can occur so early in the time course of sensory processing that purely feedback mediation becomes extremely unlikely. Second, direct neural recordings in monkeys show that, in some cases, convergent inputs at early cortical stages have physiological profiles characteristic of feedforward rather than feedback inputs. Third, damage to higher-order integrative regions in humans often spares the ability to integrate across sensory modalities. Finally, recent anatomic tracer studies have reported direct anatomical connections between primary visual and auditory cortex. These findings make it clear that multisensory convergence at early stages of cortical processing results from feedforward as well as feedback and lateral connections, thus using the full range of anatomical connections available in brain circuitry.",
keywords = "Auditory cortex, Binding, Caudo-medial belt, Crossmodal integration, Multisensory integration, Sensory integration",
author = "Foxe, {John J.} and Schroeder, {Charles E.}",
year = "2005",
month = "4",
day = "4",
doi = "10.1097/00001756-200504040-00001",
language = "English (US)",
volume = "16",
pages = "419--423",
journal = "NeuroReport",
issn = "0959-4965",
publisher = "Lippincott Williams and Wilkins",
number = "5",

}

TY - JOUR

T1 - The case for feedforward multisensory convergence during early cortical processing

AU - Foxe, John J.

AU - Schroeder, Charles E.

PY - 2005/4/4

Y1 - 2005/4/4

N2 - The prevailing hierarchical model of sensory processing in the brain holds that different modalities of sensory information emanating from a single object are analyzed extensively during passage through their respective unisensory processing streams before they are combined in higher-order 'multisensory' regions of the cortex. Because of this view, multisensory interactions that have been found at early, putatively 'unisensory' cortical processing stages during hemodynamic imaging studies have been assumed to reflect feedback modulations that occur subsequent to multisensory processing in the higher-order multisensory areas. In this paper, we consider findings that challenge an exclusively feedback interpretation of early multisensory integration effects. First, high-density electrical mapping studies in humans have shown that multisensory convergence and integration effects can occur so early in the time course of sensory processing that purely feedback mediation becomes extremely unlikely. Second, direct neural recordings in monkeys show that, in some cases, convergent inputs at early cortical stages have physiological profiles characteristic of feedforward rather than feedback inputs. Third, damage to higher-order integrative regions in humans often spares the ability to integrate across sensory modalities. Finally, recent anatomic tracer studies have reported direct anatomical connections between primary visual and auditory cortex. These findings make it clear that multisensory convergence at early stages of cortical processing results from feedforward as well as feedback and lateral connections, thus using the full range of anatomical connections available in brain circuitry.

AB - The prevailing hierarchical model of sensory processing in the brain holds that different modalities of sensory information emanating from a single object are analyzed extensively during passage through their respective unisensory processing streams before they are combined in higher-order 'multisensory' regions of the cortex. Because of this view, multisensory interactions that have been found at early, putatively 'unisensory' cortical processing stages during hemodynamic imaging studies have been assumed to reflect feedback modulations that occur subsequent to multisensory processing in the higher-order multisensory areas. In this paper, we consider findings that challenge an exclusively feedback interpretation of early multisensory integration effects. First, high-density electrical mapping studies in humans have shown that multisensory convergence and integration effects can occur so early in the time course of sensory processing that purely feedback mediation becomes extremely unlikely. Second, direct neural recordings in monkeys show that, in some cases, convergent inputs at early cortical stages have physiological profiles characteristic of feedforward rather than feedback inputs. Third, damage to higher-order integrative regions in humans often spares the ability to integrate across sensory modalities. Finally, recent anatomic tracer studies have reported direct anatomical connections between primary visual and auditory cortex. These findings make it clear that multisensory convergence at early stages of cortical processing results from feedforward as well as feedback and lateral connections, thus using the full range of anatomical connections available in brain circuitry.

KW - Auditory cortex

KW - Binding

KW - Caudo-medial belt

KW - Crossmodal integration

KW - Multisensory integration

KW - Sensory integration

UR - http://www.scopus.com/inward/record.url?scp=16444362395&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=16444362395&partnerID=8YFLogxK

U2 - 10.1097/00001756-200504040-00001

DO - 10.1097/00001756-200504040-00001

M3 - Article

C2 - 15770144

AN - SCOPUS:16444362395

VL - 16

SP - 419

EP - 423

JO - NeuroReport

JF - NeuroReport

SN - 0959-4965

IS - 5

ER -