Investigating the temporal dynamics of auditory cortical activation to silent lipreading

Michael J. Crosse, Hesham A. Elshafei, John J. Foxe, Edmund C. Lalor

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Scopus citations

Abstract

Neuroimaging research has demonstrated that observing visual speech in the absence of auditory speech activates primary auditory cortex. However, it remains unclear what this activation precisely reflects. It is well established that, during continuous auditory speech, neural activity in auditory cortex tracks the temporal envelope of the speech signal. Recently, it has been suggested that this process may in fact reflect an internal synthesis of the speech stream rather than the encoding of the envelope per se. Could silent lipreading therefore elicit a similar 'entrainment' to the envelope in the absence of auditory speech? Here, we test this hypothesis by examining the impact of lipreading accuracy on envelope tracking using electroencephalography (EEG). We provide evidence to suggest that the EEG response over left temporal scalp tracks the unheard speech more faithfully during accurate lipreading. We also demonstrate that the envelope can be reconstructed from EEG data recorded during silent lipreading with accuracy above chance level. This could have implications for brain-computer interface technology.

Original languageEnglish (US)
Title of host publication2015 7th International IEEE/EMBS Conference on Neural Engineering, NER 2015
PublisherIEEE Computer Society
Pages308-311
Number of pages4
ISBN (Electronic)9781467363891
DOIs
Publication statusPublished - Jul 1 2015
Event7th International IEEE/EMBS Conference on Neural Engineering, NER 2015 - Montpellier, France
Duration: Apr 22 2015Apr 24 2015

Publication series

NameInternational IEEE/EMBS Conference on Neural Engineering, NER
Volume2015-July
ISSN (Print)1948-3546
ISSN (Electronic)1948-3554

Other

Other7th International IEEE/EMBS Conference on Neural Engineering, NER 2015
CountryFrance
CityMontpellier
Period4/22/154/24/15

    Fingerprint

ASJC Scopus subject areas

  • Artificial Intelligence
  • Mechanical Engineering

Cite this

Crosse, M. J., Elshafei, H. A., Foxe, J. J., & Lalor, E. C. (2015). Investigating the temporal dynamics of auditory cortical activation to silent lipreading. In 2015 7th International IEEE/EMBS Conference on Neural Engineering, NER 2015 (pp. 308-311). [7146621] (International IEEE/EMBS Conference on Neural Engineering, NER; Vol. 2015-July). IEEE Computer Society. https://doi.org/10.1109/NER.2015.7146621