Multisensory representation of frequency across audition and touch: High density electrical mapping reveals early sensory-perceptual coupling

John S. Butler, John J. Foxe, Ian C. Fiebelkorn, Manuel R. Mercier, Sophie Molholm

Research output: Contribution to journalArticle

32 Citations (Scopus)

Abstract

The frequency of environmental vibrations is sampled by two of the major sensory systems, audition and touch, notwithstanding that these signals are transduced through very different physical media and entirely separate sensory epithelia. Psychophysical studies have shown that manipulating frequency in audition or touch can have a significant cross-sensory impact on perceived frequency in the other sensory system, pointing to intimate links between these senses during computation of frequency. In this regard, the frequency of a vibratory event can be thought of as a multisensory perceptual construct. In turn, electrophysiological studies point to temporally early multisensory interactions that occur in hierarchically early sensory regions where convergent inputs from the auditory and somatosensory systems are to be found. A key question pertains to the level of processing at which the multisensory integration of featural information, such as frequency, occurs. Do the sensory systems calculate frequency independently before this information is combined, or is this feature calculated in an integrated fashion during preattentive sensory processing? The well characterized mismatch negativity, an electrophysiological response that indexes preattentive detection of a change within the context of a regular pattern of stimulation, served as our dependent measure. High-density electrophysiological recordings were made in humans while they were presented with separate blocks of somatosensory, auditory, and audio-somatosensory "standards" and "deviants," where the deviant differed in frequency. Multisensory effects were identified beginning at 200 ms, with the multisensory mismatch negativity (MMN) significantly different from the sum of the unisensory MMNs. This provides compelling evidence for preattentive coupling between the somatosensory and auditory channels in the cortical representation of frequency.

Original languageEnglish (US)
Pages (from-to)15338-15344
Number of pages7
JournalJournal of Neuroscience
Volume32
Issue number44
DOIs
StatePublished - Oct 31 2012

Fingerprint

Touch
Hearing
Vibration
Epithelium

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Multisensory representation of frequency across audition and touch : High density electrical mapping reveals early sensory-perceptual coupling. / Butler, John S.; Foxe, John J.; Fiebelkorn, Ian C.; Mercier, Manuel R.; Molholm, Sophie.

In: Journal of Neuroscience, Vol. 32, No. 44, 31.10.2012, p. 15338-15344.

Research output: Contribution to journalArticle

Butler, John S. ; Foxe, John J. ; Fiebelkorn, Ian C. ; Mercier, Manuel R. ; Molholm, Sophie. / Multisensory representation of frequency across audition and touch : High density electrical mapping reveals early sensory-perceptual coupling. In: Journal of Neuroscience. 2012 ; Vol. 32, No. 44. pp. 15338-15344.
@article{18c2d4c65b6b4b29b8b9a1201b0b193a,
title = "Multisensory representation of frequency across audition and touch: High density electrical mapping reveals early sensory-perceptual coupling",
abstract = "The frequency of environmental vibrations is sampled by two of the major sensory systems, audition and touch, notwithstanding that these signals are transduced through very different physical media and entirely separate sensory epithelia. Psychophysical studies have shown that manipulating frequency in audition or touch can have a significant cross-sensory impact on perceived frequency in the other sensory system, pointing to intimate links between these senses during computation of frequency. In this regard, the frequency of a vibratory event can be thought of as a multisensory perceptual construct. In turn, electrophysiological studies point to temporally early multisensory interactions that occur in hierarchically early sensory regions where convergent inputs from the auditory and somatosensory systems are to be found. A key question pertains to the level of processing at which the multisensory integration of featural information, such as frequency, occurs. Do the sensory systems calculate frequency independently before this information is combined, or is this feature calculated in an integrated fashion during preattentive sensory processing? The well characterized mismatch negativity, an electrophysiological response that indexes preattentive detection of a change within the context of a regular pattern of stimulation, served as our dependent measure. High-density electrophysiological recordings were made in humans while they were presented with separate blocks of somatosensory, auditory, and audio-somatosensory {"}standards{"} and {"}deviants,{"} where the deviant differed in frequency. Multisensory effects were identified beginning at 200 ms, with the multisensory mismatch negativity (MMN) significantly different from the sum of the unisensory MMNs. This provides compelling evidence for preattentive coupling between the somatosensory and auditory channels in the cortical representation of frequency.",
author = "Butler, {John S.} and Foxe, {John J.} and Fiebelkorn, {Ian C.} and Mercier, {Manuel R.} and Sophie Molholm",
year = "2012",
month = "10",
day = "31",
doi = "10.1523/JNEUROSCI.1796-12.2012",
language = "English (US)",
volume = "32",
pages = "15338--15344",
journal = "Journal of Neuroscience",
issn = "0270-6474",
publisher = "Society for Neuroscience",
number = "44",

}

TY - JOUR

T1 - Multisensory representation of frequency across audition and touch

T2 - High density electrical mapping reveals early sensory-perceptual coupling

AU - Butler, John S.

AU - Foxe, John J.

AU - Fiebelkorn, Ian C.

AU - Mercier, Manuel R.

AU - Molholm, Sophie

PY - 2012/10/31

Y1 - 2012/10/31

N2 - The frequency of environmental vibrations is sampled by two of the major sensory systems, audition and touch, notwithstanding that these signals are transduced through very different physical media and entirely separate sensory epithelia. Psychophysical studies have shown that manipulating frequency in audition or touch can have a significant cross-sensory impact on perceived frequency in the other sensory system, pointing to intimate links between these senses during computation of frequency. In this regard, the frequency of a vibratory event can be thought of as a multisensory perceptual construct. In turn, electrophysiological studies point to temporally early multisensory interactions that occur in hierarchically early sensory regions where convergent inputs from the auditory and somatosensory systems are to be found. A key question pertains to the level of processing at which the multisensory integration of featural information, such as frequency, occurs. Do the sensory systems calculate frequency independently before this information is combined, or is this feature calculated in an integrated fashion during preattentive sensory processing? The well characterized mismatch negativity, an electrophysiological response that indexes preattentive detection of a change within the context of a regular pattern of stimulation, served as our dependent measure. High-density electrophysiological recordings were made in humans while they were presented with separate blocks of somatosensory, auditory, and audio-somatosensory "standards" and "deviants," where the deviant differed in frequency. Multisensory effects were identified beginning at 200 ms, with the multisensory mismatch negativity (MMN) significantly different from the sum of the unisensory MMNs. This provides compelling evidence for preattentive coupling between the somatosensory and auditory channels in the cortical representation of frequency.

AB - The frequency of environmental vibrations is sampled by two of the major sensory systems, audition and touch, notwithstanding that these signals are transduced through very different physical media and entirely separate sensory epithelia. Psychophysical studies have shown that manipulating frequency in audition or touch can have a significant cross-sensory impact on perceived frequency in the other sensory system, pointing to intimate links between these senses during computation of frequency. In this regard, the frequency of a vibratory event can be thought of as a multisensory perceptual construct. In turn, electrophysiological studies point to temporally early multisensory interactions that occur in hierarchically early sensory regions where convergent inputs from the auditory and somatosensory systems are to be found. A key question pertains to the level of processing at which the multisensory integration of featural information, such as frequency, occurs. Do the sensory systems calculate frequency independently before this information is combined, or is this feature calculated in an integrated fashion during preattentive sensory processing? The well characterized mismatch negativity, an electrophysiological response that indexes preattentive detection of a change within the context of a regular pattern of stimulation, served as our dependent measure. High-density electrophysiological recordings were made in humans while they were presented with separate blocks of somatosensory, auditory, and audio-somatosensory "standards" and "deviants," where the deviant differed in frequency. Multisensory effects were identified beginning at 200 ms, with the multisensory mismatch negativity (MMN) significantly different from the sum of the unisensory MMNs. This provides compelling evidence for preattentive coupling between the somatosensory and auditory channels in the cortical representation of frequency.

UR - http://www.scopus.com/inward/record.url?scp=84868087239&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84868087239&partnerID=8YFLogxK

U2 - 10.1523/JNEUROSCI.1796-12.2012

DO - 10.1523/JNEUROSCI.1796-12.2012

M3 - Article

C2 - 23115172

AN - SCOPUS:84868087239

VL - 32

SP - 15338

EP - 15344

JO - Journal of Neuroscience

JF - Journal of Neuroscience

SN - 0270-6474

IS - 44

ER -