Retrospectively supervised click decoder calibration for self-calibrating point-and-click brain–computer interfaces

Beata Jarosiewicz, Anish A. Sarma, Jad Saab, Brian Franco, Sydney S. Cash, Emad N. Eskandar, Leigh R. Hochberg

Research output: Contribution to journalArticle

4 Scopus citations

Abstract

Brain-computer interfaces (BCIs) aim to restore independence to people with severe motor disabilities by allowing control of a cursor on a computer screen or other effectors with neural activity. However, physiological and/or recording-related nonstationarities in neural signals can limit long-term decoding stability, and it would be tedious for users to pause use of the BCI whenever neural control degrades to perform decoder recalibration routines. We recently demonstrated that a kinematic decoder (i.e. a decoder that controls cursor movement) can be recalibrated using data acquired during practical point-and-click control of the BCI by retrospectively inferring users’ intended movement directions based on their subsequent selections. Here, we extend these methods to allow the click decoder to also be recalibrated using data acquired during practical BCI use. We retrospectively labeled neural data patterns as corresponding to “click” during all time bins in which the click log-likelihood (decoded using linear discriminant analysis, or LDA) had been above the click threshold that was used during real-time neural control. We labeled as “non-click” those periods that the kinematic decoder's retrospective target inference (RTI) heuristics determined to be consistent with intended cursor movement. Once these neural activity patterns were labeled, the click decoder was calibrated using standard supervised classifier training methods. Combined with real-time bias correction and baseline firing rate tracking, this set of “retrospectively labeled” decoder calibration methods enabled a BrainGate participant with amyotrophic lateral sclerosis (T9) to type freely across 11 research sessions spanning 29 days, maintaining high-performance neural control over cursor movement and click without needing to interrupt virtual keyboard use for explicit calibration tasks. By eliminating the need for tedious calibration tasks with prescribed targets and pre-specified click times, this approach advances the potential clinical utility of intracortical BCIs for individuals with severe motor disability.

Original languageEnglish (US)
Pages (from-to)382-391
Number of pages10
JournalJournal of Physiology Paris
Volume110
Issue number4
DOIs
StatePublished - Nov 1 2016
Externally publishedYes

Keywords

  • Adaptive classification
  • Amyotrophic lateral sclerosis (ALS)
  • Augmentative and assistive communication (AAC)
  • Brain-Machine Interface (BMI)
  • Spinal cord injury (SCI)
  • Stroke

ASJC Scopus subject areas

  • Neuroscience(all)
  • Physiology (medical)

Fingerprint Dive into the research topics of 'Retrospectively supervised click decoder calibration for self-calibrating point-and-click brain–computer interfaces'. Together they form a unique fingerprint.

  • Cite this