TY - JOUR
T1 - Staying within the lines
T2 - The formation of visuospatial boundaries influences multisensory feature integration
AU - Fiebelkorn, Ian C.
AU - Foxe, John J.
AU - Schwartz, Theodore H.
AU - Molholm, Sophie
N1 - Copyright:
Copyright 2015 Elsevier B.V., All rights reserved.
PY - 2010/5
Y1 - 2010/5
N2 - The brain processes multisensory features of an object (e.g., its sound and shape) in separate cortical regions. A key question is how representations of these features bind together to form a coherent percept (the 'binding problem'). Here we tested the hypothesis that the determination of an object's visuospatial boundaries is paramount to the linking of its multisensory features (i.e., that the refinement of attended space through the formation of visual boundaries establishes the boundaries for multisensory feature integration). We recorded both scalp and intracranial electrophysiological data in response to Kanizsa-type illusory contour stimuli (in which pacman-like elements give the impression of a single object), their non-illusory counterparts, and auditory stimuli. Participants performed a visual task and ignored sounds. Enhanced processing of task-irrelevant sounds when paired with attended visual stimuli served as our metric for multisensory feature integration [e.g., Busse et al. (2005) Proc. Natl Acad. Sci. USA 102: 18751-18756]. According to our hypothesis, task-irrelevant sounds paired with Kanizsa-type illusory contour stimuli (which have well-defined boundaries) should receive enhanced processing relative to task-irrelevant sounds paired with non-illusory contour stimuli (which have ambiguous boundaries). The scalp data clearly support this prediction and, combined with the intracranial data, advocate for an important extension of models for multisensory feature integration. We propose a model in which (i) the visual boundaries of an object are established through processing in occipitotemporal cortex, and (ii) attention then spreads to cortical regions that process features that fall within the object's established visual boundaries, including its task-irrelevant multisensory features.
AB - The brain processes multisensory features of an object (e.g., its sound and shape) in separate cortical regions. A key question is how representations of these features bind together to form a coherent percept (the 'binding problem'). Here we tested the hypothesis that the determination of an object's visuospatial boundaries is paramount to the linking of its multisensory features (i.e., that the refinement of attended space through the formation of visual boundaries establishes the boundaries for multisensory feature integration). We recorded both scalp and intracranial electrophysiological data in response to Kanizsa-type illusory contour stimuli (in which pacman-like elements give the impression of a single object), their non-illusory counterparts, and auditory stimuli. Participants performed a visual task and ignored sounds. Enhanced processing of task-irrelevant sounds when paired with attended visual stimuli served as our metric for multisensory feature integration [e.g., Busse et al. (2005) Proc. Natl Acad. Sci. USA 102: 18751-18756]. According to our hypothesis, task-irrelevant sounds paired with Kanizsa-type illusory contour stimuli (which have well-defined boundaries) should receive enhanced processing relative to task-irrelevant sounds paired with non-illusory contour stimuli (which have ambiguous boundaries). The scalp data clearly support this prediction and, combined with the intracranial data, advocate for an important extension of models for multisensory feature integration. We propose a model in which (i) the visual boundaries of an object are established through processing in occipitotemporal cortex, and (ii) attention then spreads to cortical regions that process features that fall within the object's established visual boundaries, including its task-irrelevant multisensory features.
KW - Attention
KW - Binding problem
KW - Electrophysiology
KW - Object processing
UR - http://www.scopus.com/inward/record.url?scp=77952612947&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77952612947&partnerID=8YFLogxK
U2 - 10.1111/j.1460-9568.2010.07196.x
DO - 10.1111/j.1460-9568.2010.07196.x
M3 - Article
C2 - 20584177
AN - SCOPUS:77952612947
SN - 0953-816X
VL - 31
SP - 1737
EP - 1743
JO - European Journal of Neuroscience
JF - European Journal of Neuroscience
IS - 10
ER -