Staying within the lines

The formation of visuospatial boundaries influences multisensory feature integration

Ian C. Fiebelkorn, John J. Foxe, Theodore H. Schwartz, Sophie Molholm

Research output: Contribution to journalArticle

16 Citations (Scopus)

Abstract

The brain processes multisensory features of an object (e.g., its sound and shape) in separate cortical regions. A key question is how representations of these features bind together to form a coherent percept (the 'binding problem'). Here we tested the hypothesis that the determination of an object's visuospatial boundaries is paramount to the linking of its multisensory features (i.e., that the refinement of attended space through the formation of visual boundaries establishes the boundaries for multisensory feature integration). We recorded both scalp and intracranial electrophysiological data in response to Kanizsa-type illusory contour stimuli (in which pacman-like elements give the impression of a single object), their non-illusory counterparts, and auditory stimuli. Participants performed a visual task and ignored sounds. Enhanced processing of task-irrelevant sounds when paired with attended visual stimuli served as our metric for multisensory feature integration [e.g., Busse et al. (2005) Proc. Natl Acad. Sci. USA 102: 18751-18756]. According to our hypothesis, task-irrelevant sounds paired with Kanizsa-type illusory contour stimuli (which have well-defined boundaries) should receive enhanced processing relative to task-irrelevant sounds paired with non-illusory contour stimuli (which have ambiguous boundaries). The scalp data clearly support this prediction and, combined with the intracranial data, advocate for an important extension of models for multisensory feature integration. We propose a model in which (i) the visual boundaries of an object are established through processing in occipitotemporal cortex, and (ii) attention then spreads to cortical regions that process features that fall within the object's established visual boundaries, including its task-irrelevant multisensory features.

Original languageEnglish (US)
Pages (from-to)1737-1743
Number of pages7
JournalEuropean Journal of Neuroscience
Volume31
Issue number10
DOIs
StatePublished - 2010

Fingerprint

Scalp
Brain

Keywords

  • Attention
  • Binding problem
  • Electrophysiology
  • Object processing

ASJC Scopus subject areas

  • Neuroscience(all)
  • Medicine(all)

Cite this

Staying within the lines : The formation of visuospatial boundaries influences multisensory feature integration. / Fiebelkorn, Ian C.; Foxe, John J.; Schwartz, Theodore H.; Molholm, Sophie.

In: European Journal of Neuroscience, Vol. 31, No. 10, 2010, p. 1737-1743.

Research output: Contribution to journalArticle

Fiebelkorn, Ian C. ; Foxe, John J. ; Schwartz, Theodore H. ; Molholm, Sophie. / Staying within the lines : The formation of visuospatial boundaries influences multisensory feature integration. In: European Journal of Neuroscience. 2010 ; Vol. 31, No. 10. pp. 1737-1743.
@article{f3d150060e4749ed9c7825c179f603f1,
title = "Staying within the lines: The formation of visuospatial boundaries influences multisensory feature integration",
abstract = "The brain processes multisensory features of an object (e.g., its sound and shape) in separate cortical regions. A key question is how representations of these features bind together to form a coherent percept (the 'binding problem'). Here we tested the hypothesis that the determination of an object's visuospatial boundaries is paramount to the linking of its multisensory features (i.e., that the refinement of attended space through the formation of visual boundaries establishes the boundaries for multisensory feature integration). We recorded both scalp and intracranial electrophysiological data in response to Kanizsa-type illusory contour stimuli (in which pacman-like elements give the impression of a single object), their non-illusory counterparts, and auditory stimuli. Participants performed a visual task and ignored sounds. Enhanced processing of task-irrelevant sounds when paired with attended visual stimuli served as our metric for multisensory feature integration [e.g., Busse et al. (2005) Proc. Natl Acad. Sci. USA 102: 18751-18756]. According to our hypothesis, task-irrelevant sounds paired with Kanizsa-type illusory contour stimuli (which have well-defined boundaries) should receive enhanced processing relative to task-irrelevant sounds paired with non-illusory contour stimuli (which have ambiguous boundaries). The scalp data clearly support this prediction and, combined with the intracranial data, advocate for an important extension of models for multisensory feature integration. We propose a model in which (i) the visual boundaries of an object are established through processing in occipitotemporal cortex, and (ii) attention then spreads to cortical regions that process features that fall within the object's established visual boundaries, including its task-irrelevant multisensory features.",
keywords = "Attention, Binding problem, Electrophysiology, Object processing",
author = "Fiebelkorn, {Ian C.} and Foxe, {John J.} and Schwartz, {Theodore H.} and Sophie Molholm",
year = "2010",
doi = "10.1111/j.1460-9568.2010.07196.x",
language = "English (US)",
volume = "31",
pages = "1737--1743",
journal = "European Journal of Neuroscience",
issn = "0953-816X",
publisher = "Wiley-Blackwell",
number = "10",

}

TY - JOUR

T1 - Staying within the lines

T2 - The formation of visuospatial boundaries influences multisensory feature integration

AU - Fiebelkorn, Ian C.

AU - Foxe, John J.

AU - Schwartz, Theodore H.

AU - Molholm, Sophie

PY - 2010

Y1 - 2010

N2 - The brain processes multisensory features of an object (e.g., its sound and shape) in separate cortical regions. A key question is how representations of these features bind together to form a coherent percept (the 'binding problem'). Here we tested the hypothesis that the determination of an object's visuospatial boundaries is paramount to the linking of its multisensory features (i.e., that the refinement of attended space through the formation of visual boundaries establishes the boundaries for multisensory feature integration). We recorded both scalp and intracranial electrophysiological data in response to Kanizsa-type illusory contour stimuli (in which pacman-like elements give the impression of a single object), their non-illusory counterparts, and auditory stimuli. Participants performed a visual task and ignored sounds. Enhanced processing of task-irrelevant sounds when paired with attended visual stimuli served as our metric for multisensory feature integration [e.g., Busse et al. (2005) Proc. Natl Acad. Sci. USA 102: 18751-18756]. According to our hypothesis, task-irrelevant sounds paired with Kanizsa-type illusory contour stimuli (which have well-defined boundaries) should receive enhanced processing relative to task-irrelevant sounds paired with non-illusory contour stimuli (which have ambiguous boundaries). The scalp data clearly support this prediction and, combined with the intracranial data, advocate for an important extension of models for multisensory feature integration. We propose a model in which (i) the visual boundaries of an object are established through processing in occipitotemporal cortex, and (ii) attention then spreads to cortical regions that process features that fall within the object's established visual boundaries, including its task-irrelevant multisensory features.

AB - The brain processes multisensory features of an object (e.g., its sound and shape) in separate cortical regions. A key question is how representations of these features bind together to form a coherent percept (the 'binding problem'). Here we tested the hypothesis that the determination of an object's visuospatial boundaries is paramount to the linking of its multisensory features (i.e., that the refinement of attended space through the formation of visual boundaries establishes the boundaries for multisensory feature integration). We recorded both scalp and intracranial electrophysiological data in response to Kanizsa-type illusory contour stimuli (in which pacman-like elements give the impression of a single object), their non-illusory counterparts, and auditory stimuli. Participants performed a visual task and ignored sounds. Enhanced processing of task-irrelevant sounds when paired with attended visual stimuli served as our metric for multisensory feature integration [e.g., Busse et al. (2005) Proc. Natl Acad. Sci. USA 102: 18751-18756]. According to our hypothesis, task-irrelevant sounds paired with Kanizsa-type illusory contour stimuli (which have well-defined boundaries) should receive enhanced processing relative to task-irrelevant sounds paired with non-illusory contour stimuli (which have ambiguous boundaries). The scalp data clearly support this prediction and, combined with the intracranial data, advocate for an important extension of models for multisensory feature integration. We propose a model in which (i) the visual boundaries of an object are established through processing in occipitotemporal cortex, and (ii) attention then spreads to cortical regions that process features that fall within the object's established visual boundaries, including its task-irrelevant multisensory features.

KW - Attention

KW - Binding problem

KW - Electrophysiology

KW - Object processing

UR - http://www.scopus.com/inward/record.url?scp=77952612947&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77952612947&partnerID=8YFLogxK

U2 - 10.1111/j.1460-9568.2010.07196.x

DO - 10.1111/j.1460-9568.2010.07196.x

M3 - Article

VL - 31

SP - 1737

EP - 1743

JO - European Journal of Neuroscience

JF - European Journal of Neuroscience

SN - 0953-816X

IS - 10

ER -