A computational analysis of neural mechanisms underlying the maturation of multisensory speech integration in neurotypical children and those on the autism spectrum

Cristiano Cuppini, Mauro Ursino, Elisa Magosso, Lars A. Ross, John J. Foxe, Sophie Molholm

Research output: Contribution to journalArticle

Abstract

Failure to appropriately develop multisensory integration (MSI) of audiovisual speech may affect a child’s ability to attain optimal communication. Studies have shown protracted development of MSI into late-childhood and identified deficits in MSI in children with an autism spectrum disorder (ASD). Currently, the neural basis of acquisition of this ability is not well understood. Here, we developed a computational model informed by neurophysiology to analyze possible mechanisms underlying MSI maturation, and its delayed development in ASD. The model posits that strengthening of feedforward and cross-sensory connections, responsible for the alignment of auditory and visual speech sound representations in posterior superior temporal gyrus/sulcus, can explain behavioral data on the acquisition of MSI. This was simulated by a training phase during which the network was exposed to unisensory and multisensory stimuli, and projections were crafted by Hebbian rules of potentiation and depression. In its mature architecture, the network also reproduced the well-known multisensory McGurk speech effect. Deficits in audiovisual speech perception in ASD were well accounted for by fewer multisensory exposures, compatible with a lack of attention, but not by reduced synaptic connectivity or synaptic plasticity.

Original languageEnglish (US)
Article number518
JournalFrontiers in Human Neuroscience
Volume11
DOIs
StatePublished - Oct 1 2017

Fingerprint

Autistic Disorder
Aptitude
Speech Perception
Neurophysiology
Neuronal Plasticity
Phonetics
Temporal Lobe
Communication
Depression
Autism Spectrum Disorder

Keywords

  • Development
  • Hebbian learning rules
  • McGurk effect
  • Multisensory training
  • Neural network
  • Speech comprehension

ASJC Scopus subject areas

  • Neuropsychology and Physiological Psychology
  • Neurology
  • Psychiatry and Mental health
  • Biological Psychiatry
  • Behavioral Neuroscience

Cite this

A computational analysis of neural mechanisms underlying the maturation of multisensory speech integration in neurotypical children and those on the autism spectrum. / Cuppini, Cristiano; Ursino, Mauro; Magosso, Elisa; Ross, Lars A.; Foxe, John J.; Molholm, Sophie.

In: Frontiers in Human Neuroscience, Vol. 11, 518, 01.10.2017.

Research output: Contribution to journalArticle

@article{76d01637fda74874bf3847a185175163,
title = "A computational analysis of neural mechanisms underlying the maturation of multisensory speech integration in neurotypical children and those on the autism spectrum",
abstract = "Failure to appropriately develop multisensory integration (MSI) of audiovisual speech may affect a child’s ability to attain optimal communication. Studies have shown protracted development of MSI into late-childhood and identified deficits in MSI in children with an autism spectrum disorder (ASD). Currently, the neural basis of acquisition of this ability is not well understood. Here, we developed a computational model informed by neurophysiology to analyze possible mechanisms underlying MSI maturation, and its delayed development in ASD. The model posits that strengthening of feedforward and cross-sensory connections, responsible for the alignment of auditory and visual speech sound representations in posterior superior temporal gyrus/sulcus, can explain behavioral data on the acquisition of MSI. This was simulated by a training phase during which the network was exposed to unisensory and multisensory stimuli, and projections were crafted by Hebbian rules of potentiation and depression. In its mature architecture, the network also reproduced the well-known multisensory McGurk speech effect. Deficits in audiovisual speech perception in ASD were well accounted for by fewer multisensory exposures, compatible with a lack of attention, but not by reduced synaptic connectivity or synaptic plasticity.",
keywords = "Development, Hebbian learning rules, McGurk effect, Multisensory training, Neural network, Speech comprehension",
author = "Cristiano Cuppini and Mauro Ursino and Elisa Magosso and Ross, {Lars A.} and Foxe, {John J.} and Sophie Molholm",
year = "2017",
month = "10",
day = "1",
doi = "10.3389/fnhum.2017.00518",
language = "English (US)",
volume = "11",
journal = "Frontiers in Human Neuroscience",
issn = "1662-5161",
publisher = "Frontiers Research Foundation",

}

TY - JOUR

T1 - A computational analysis of neural mechanisms underlying the maturation of multisensory speech integration in neurotypical children and those on the autism spectrum

AU - Cuppini, Cristiano

AU - Ursino, Mauro

AU - Magosso, Elisa

AU - Ross, Lars A.

AU - Foxe, John J.

AU - Molholm, Sophie

PY - 2017/10/1

Y1 - 2017/10/1

N2 - Failure to appropriately develop multisensory integration (MSI) of audiovisual speech may affect a child’s ability to attain optimal communication. Studies have shown protracted development of MSI into late-childhood and identified deficits in MSI in children with an autism spectrum disorder (ASD). Currently, the neural basis of acquisition of this ability is not well understood. Here, we developed a computational model informed by neurophysiology to analyze possible mechanisms underlying MSI maturation, and its delayed development in ASD. The model posits that strengthening of feedforward and cross-sensory connections, responsible for the alignment of auditory and visual speech sound representations in posterior superior temporal gyrus/sulcus, can explain behavioral data on the acquisition of MSI. This was simulated by a training phase during which the network was exposed to unisensory and multisensory stimuli, and projections were crafted by Hebbian rules of potentiation and depression. In its mature architecture, the network also reproduced the well-known multisensory McGurk speech effect. Deficits in audiovisual speech perception in ASD were well accounted for by fewer multisensory exposures, compatible with a lack of attention, but not by reduced synaptic connectivity or synaptic plasticity.

AB - Failure to appropriately develop multisensory integration (MSI) of audiovisual speech may affect a child’s ability to attain optimal communication. Studies have shown protracted development of MSI into late-childhood and identified deficits in MSI in children with an autism spectrum disorder (ASD). Currently, the neural basis of acquisition of this ability is not well understood. Here, we developed a computational model informed by neurophysiology to analyze possible mechanisms underlying MSI maturation, and its delayed development in ASD. The model posits that strengthening of feedforward and cross-sensory connections, responsible for the alignment of auditory and visual speech sound representations in posterior superior temporal gyrus/sulcus, can explain behavioral data on the acquisition of MSI. This was simulated by a training phase during which the network was exposed to unisensory and multisensory stimuli, and projections were crafted by Hebbian rules of potentiation and depression. In its mature architecture, the network also reproduced the well-known multisensory McGurk speech effect. Deficits in audiovisual speech perception in ASD were well accounted for by fewer multisensory exposures, compatible with a lack of attention, but not by reduced synaptic connectivity or synaptic plasticity.

KW - Development

KW - Hebbian learning rules

KW - McGurk effect

KW - Multisensory training

KW - Neural network

KW - Speech comprehension

UR - http://www.scopus.com/inward/record.url?scp=85036667525&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85036667525&partnerID=8YFLogxK

U2 - 10.3389/fnhum.2017.00518

DO - 10.3389/fnhum.2017.00518

M3 - Article

VL - 11

JO - Frontiers in Human Neuroscience

JF - Frontiers in Human Neuroscience

SN - 1662-5161

M1 - 518

ER -