Visual cues can modulate integration and segregation of objects in auditory scene analysis

Torsten Rahne, Martin Böckmann, Hellmut von Specht, Elyse S. Sussman

Research output: Contribution to journalArticle

32 Citations (Scopus)

Abstract

The task of assigning concurrent sounds to different auditory objects is known to depend on temporal and spectral cues. When tones of high and low frequencies are presented in alternation, they can be perceived as a single, integrated melody, or as two parallel, segregated melodic lines, according to the presentation rate and frequency distance between the sounds. At an intermediate distance, in the 'ambiguous' range, both percepts are possible. We conducted an electrophysiological experiment to determine whether an ambiguous sound organization could be modulated toward an integrated or segregated percept by the synchronous presentation of visual cues. Two sets of sounds (one high frequency and one low frequency) were interleaved. To promote integration or segregation, visual stimuli were synchronized to either the within-set frequency pattern or to the across-set intensity pattern. Elicitation of the mismatch negativity (MMN) component of event-related brain potentials was used to index the segregated organization, when no task was performed with the sounds. MMN was elicited only when the visual pattern promoted the segregation of the sounds. The results demonstrate cross-modal effects on auditory object perception in that sound ambiguity was resolved by synchronous presentation of visual stimuli, which promoted either an integrated or segregated perception of the sounds.

Original languageEnglish (US)
Pages (from-to)127-135
Number of pages9
JournalBrain Research
Volume1144
Issue number1
DOIs
StatePublished - May 4 2007

Fingerprint

Cues
Auditory Perception
Evoked Potentials
Brain

Keywords

  • Audiovisual interaction
  • Auditory perception
  • Auditory scene analysis
  • Cross-modal perception
  • Mismatch negativity (MMN)

ASJC Scopus subject areas

  • Neuroscience(all)
  • Clinical Neurology
  • Developmental Biology
  • Molecular Biology

Cite this

Visual cues can modulate integration and segregation of objects in auditory scene analysis. / Rahne, Torsten; Böckmann, Martin; von Specht, Hellmut; Sussman, Elyse S.

In: Brain Research, Vol. 1144, No. 1, 04.05.2007, p. 127-135.

Research output: Contribution to journalArticle

Rahne, Torsten ; Böckmann, Martin ; von Specht, Hellmut ; Sussman, Elyse S. / Visual cues can modulate integration and segregation of objects in auditory scene analysis. In: Brain Research. 2007 ; Vol. 1144, No. 1. pp. 127-135.
@article{8f82ca8706014508b6d3db8bd53e6259,
title = "Visual cues can modulate integration and segregation of objects in auditory scene analysis",
abstract = "The task of assigning concurrent sounds to different auditory objects is known to depend on temporal and spectral cues. When tones of high and low frequencies are presented in alternation, they can be perceived as a single, integrated melody, or as two parallel, segregated melodic lines, according to the presentation rate and frequency distance between the sounds. At an intermediate distance, in the 'ambiguous' range, both percepts are possible. We conducted an electrophysiological experiment to determine whether an ambiguous sound organization could be modulated toward an integrated or segregated percept by the synchronous presentation of visual cues. Two sets of sounds (one high frequency and one low frequency) were interleaved. To promote integration or segregation, visual stimuli were synchronized to either the within-set frequency pattern or to the across-set intensity pattern. Elicitation of the mismatch negativity (MMN) component of event-related brain potentials was used to index the segregated organization, when no task was performed with the sounds. MMN was elicited only when the visual pattern promoted the segregation of the sounds. The results demonstrate cross-modal effects on auditory object perception in that sound ambiguity was resolved by synchronous presentation of visual stimuli, which promoted either an integrated or segregated perception of the sounds.",
keywords = "Audiovisual interaction, Auditory perception, Auditory scene analysis, Cross-modal perception, Mismatch negativity (MMN)",
author = "Torsten Rahne and Martin B{\"o}ckmann and {von Specht}, Hellmut and Sussman, {Elyse S.}",
year = "2007",
month = "5",
day = "4",
doi = "10.1016/j.brainres.2007.01.074",
language = "English (US)",
volume = "1144",
pages = "127--135",
journal = "Brain Research",
issn = "0006-8993",
publisher = "Elsevier",
number = "1",

}

TY - JOUR

T1 - Visual cues can modulate integration and segregation of objects in auditory scene analysis

AU - Rahne, Torsten

AU - Böckmann, Martin

AU - von Specht, Hellmut

AU - Sussman, Elyse S.

PY - 2007/5/4

Y1 - 2007/5/4

N2 - The task of assigning concurrent sounds to different auditory objects is known to depend on temporal and spectral cues. When tones of high and low frequencies are presented in alternation, they can be perceived as a single, integrated melody, or as two parallel, segregated melodic lines, according to the presentation rate and frequency distance between the sounds. At an intermediate distance, in the 'ambiguous' range, both percepts are possible. We conducted an electrophysiological experiment to determine whether an ambiguous sound organization could be modulated toward an integrated or segregated percept by the synchronous presentation of visual cues. Two sets of sounds (one high frequency and one low frequency) were interleaved. To promote integration or segregation, visual stimuli were synchronized to either the within-set frequency pattern or to the across-set intensity pattern. Elicitation of the mismatch negativity (MMN) component of event-related brain potentials was used to index the segregated organization, when no task was performed with the sounds. MMN was elicited only when the visual pattern promoted the segregation of the sounds. The results demonstrate cross-modal effects on auditory object perception in that sound ambiguity was resolved by synchronous presentation of visual stimuli, which promoted either an integrated or segregated perception of the sounds.

AB - The task of assigning concurrent sounds to different auditory objects is known to depend on temporal and spectral cues. When tones of high and low frequencies are presented in alternation, they can be perceived as a single, integrated melody, or as two parallel, segregated melodic lines, according to the presentation rate and frequency distance between the sounds. At an intermediate distance, in the 'ambiguous' range, both percepts are possible. We conducted an electrophysiological experiment to determine whether an ambiguous sound organization could be modulated toward an integrated or segregated percept by the synchronous presentation of visual cues. Two sets of sounds (one high frequency and one low frequency) were interleaved. To promote integration or segregation, visual stimuli were synchronized to either the within-set frequency pattern or to the across-set intensity pattern. Elicitation of the mismatch negativity (MMN) component of event-related brain potentials was used to index the segregated organization, when no task was performed with the sounds. MMN was elicited only when the visual pattern promoted the segregation of the sounds. The results demonstrate cross-modal effects on auditory object perception in that sound ambiguity was resolved by synchronous presentation of visual stimuli, which promoted either an integrated or segregated perception of the sounds.

KW - Audiovisual interaction

KW - Auditory perception

KW - Auditory scene analysis

KW - Cross-modal perception

KW - Mismatch negativity (MMN)

UR - http://www.scopus.com/inward/record.url?scp=33947314821&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33947314821&partnerID=8YFLogxK

U2 - 10.1016/j.brainres.2007.01.074

DO - 10.1016/j.brainres.2007.01.074

M3 - Article

VL - 1144

SP - 127

EP - 135

JO - Brain Research

JF - Brain Research

SN - 0006-8993

IS - 1

ER -