Abstract:
OBJECTIVE:To evaluate the potential of intracortical electrode array signals for brain-computer interfaces (BCIs) to restore lost speech, we measured the performance of decoders trained to discriminate a comprehensive basis set of 39 English phonemes and to synthesize speech sounds via a neural pattern matching method. We decoded neural correlates of spoken-out-loud words in the 'hand knob' area of precentral gyrus, a step toward the eventual goal of decoding attempted speech from ventral speech areas in patients who are unable to speak. APPROACH:Neural and audio data were recorded while two BrainGate2 pilot clinical trial participants, each with two chronically-implanted 96-electrode arrays, spoke 420 different words that broadly sampled English phonemes. Phoneme onsets were identified from audio recordings, and their identities were then classified from neural features consisting of each electrode's binned action potential counts or high-frequency local field potential power. Speech synthesis was performed using the 'Brain-to-Speech' pattern matching method. We also examined two potential confounds specific to decoding overt speech: acoustic contamination of neural signals and systematic differences in labeling different phonemes' onset times. MAIN RESULTS:A linear decoder achieved up to 29.3% classification accuracy (chance = 6%) across 39 phonemes, while an RNN classifier achieved 33.9% accuracy. Parameter sweeps indicated that performance did not saturate when adding more electrodes or more training data, and that accuracy improved when utilizing time-varying structure in the data. Microphonic contamination and phoneme onset differences modestly increased decoding accuracy, but could be mitigated by acoustic artifact subtraction and using a neural speech onset marker, respectively. Speech synthesis achieved r = 0.523 correlation between true and reconstructed audio. SIGNIFICANCE:The ability to decode speech using intracortical electrode array signals from a nontraditional speech area suggests that placing electrode arrays in ventral speech areas is a promising direction for speech BCIs.
journal_name
J Neural Engjournal_title
Journal of neural engineeringauthors
Wilson GH,Stavisky SD,Willett FR,Avansino DT,Kelemen JN,Hochberg LR,Henderson JM,Druckmann S,Shenoy KVdoi
10.1088/1741-2552/abbfefsubject
Has Abstractpub_date
2020-11-25 00:00:00pages
066007issue
6eissn
1741-2560issn
1741-2552journal_volume
17pub_type
杂志文章abstract:OBJECTIVE:Neuromodulation technologies are increasingly used for improving function after neural injury. To achieve a symbiotic relationship between device and user, the device must augment remaining function, and independently adapt to day-to-day changes in function. The goal of this study was to develop predictive co...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/ab8e8e
更新日期:2020-06-02 00:00:00
abstract:OBJECTIVE:Spike detection from extracellular recordings is a crucial preprocessing step when analyzing neuronal activity. The decision whether a specific part of the signal is a spike or not is important for any kind of other subsequent preprocessing steps, like spike sorting or burst detection in order to reduce the c...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/aa654b
更新日期:2017-06-01 00:00:00
abstract::Implantable electrode arrays capable of recording and stimulating neural activity with high spatial and temporal resolution will provide a foundation for future brain computer interface technology. Currently, their clinical impact has been curtailed by a general lack of functional stability, which can be attributed to...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/5/4/003
更新日期:2008-12-01 00:00:00
abstract::Neural activity can be modulated by applying a polarizing low-frequency (<100 Hz) electric field (PLEF). Unlike conventional pulsed stimulation, PLEF stimulation has a graded, modulatory effect on neuronal excitability, and permits the simultaneous recording of neuronal activity during stimulation suitable for continu...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/6/4/046009
更新日期:2009-08-01 00:00:00
abstract:OBJECTIVE:Recording of neural signals from intact peripheral nerves in patients with spinal cord injury or stroke survivors offers the possibility for the development of closed-loop sensorimotor prostheses. Nerve cuffs have been found to provide stable recordings from peripheral nerves for prolonged periods of time. Ho...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/aabca0
更新日期:2018-08-01 00:00:00
abstract:OBJECTIVE:High-fidelity vibrokinetic (HFVK) technology is widely used to enhance the immersiveness of audiovisual (AV) entertainment experiences. However, despite evidence that HFVK technology does subjectively enhance AV immersion, the underlying mechanism has not been clarified. Neurophysiological studies could provi...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/abaca2
更新日期:2020-09-26 00:00:00
abstract:OBJECTIVE:One of the main goals of brain-machine interface (BMI) research is to restore function to people with paralysis. Currently, multiple BMI design features are being investigated, based on various input modalities (externally applied and surgically implantable sensors) and output modalities (e.g. control of comp...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/12/4/043002
更新日期:2015-08-01 00:00:00
abstract::The modern multi-channel cochlear implant is widely considered to be the most successful neural prosthesis owing to its ability to restore partial hearing to post-lingually deafened adults and to allow essentially normal language development in pre-lingually deafened children. However, the implant performance varies g...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/8/4/046029
更新日期:2011-08-01 00:00:00
abstract:OBJECTIVE:Analysis of intra- and perioperatively recorded cortical and basal ganglia local field potentials in human movement disorders has provided great insight into the pathophysiology of diseases such as Parkinson's, dystonia, and essential tremor. However, in order to better understand the network abnormalities an...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/11/1/016009
更新日期:2014-02-01 00:00:00
abstract::Hybrid electro-optical neural stimulation is a novel paradigm combining the advantages of optical and electrical stimulation techniques while reducing their respective limitations. However, in order to fulfill its promise, this technique requires reduced variability and improved reproducibility. Here we used a compara...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/9/3/036003
更新日期:2012-06-01 00:00:00
abstract:OBJECTIVE:The use of natural sounds in auditory Brain-Computer Interfaces (BCI) has been shown to improve classification results and usability. Some auditory BCIs are based on stream segregation, in which the subjects must attend one audio stream and ignore the other(s); these streams include some kind of stimuli to be...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/abdd44
更新日期:2021-01-19 00:00:00
abstract:OBJECTIVE:Cochlear implants, while providing significant benefits to recipients, remain limited due to broad neural activation. Focussed multipolar stimulation (FMP) is an advanced stimulation strategy that uses multiple current sources to produce highly focussed patterns of neural excitation in order to overcome these...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/aad0a5
更新日期:2018-10-01 00:00:00
abstract:OBJECTIVE:The objective of this work is to present gumpy, a new free and open source Python toolbox designed for hybrid brain-computer interface (BCI). APPROACH:Gumpy provides state-of-the-art algorithms and includes a rich selection of signal processing methods that have been employed by the BCI community over the la...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/aae186
更新日期:2018-12-01 00:00:00
abstract::In this paper, we investigate the influence of hypercapnia on the dynamics of the phrenic neurogram in the piglet in two different age groups: 3-7 days (n = 11) and 10-16 days (n = 9). The phrenic neurogram was recorded from 17 piglets (3-16 days old) during control (40% O(2) with 3-5% end-tidal CO(2)), mild hypercapn...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/2/2/004
更新日期:2005-06-01 00:00:00
abstract::Golgi tendon organs (GTOs) located in the skeletal muscles provide the central nervous system with information about muscle tension. The ensemble firing of all GTO receptors in the muscle has been hypothesized to represent a reliable measure of the whole muscle force but the precision and accuracy of that information ...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/6/3/036001
更新日期:2009-06-01 00:00:00
abstract:OBJECTIVE:Current brain-computer interface (BCI) studies demonstrate the potential to decode neural signals obtained from structured and trial-based tasks to drive actuators with high performance within the context of these tasks. Ideally, to maximize utility, such systems will be applied to a wide range of behavioral ...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/aaee9c
更新日期:2019-02-01 00:00:00
abstract:OBJECTIVE:Retinal prosthetic implants restore partial vision to patients blinded due to outer retinal degeneration, using a camera-guided multielectrode array (MEA) that electrically stimulates surviving retinal neurons. Commercial epi-retinal prostheses use millisecond-scale charge-balanced, symmetric, cathodic-first ...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/aaf92b
更新日期:2019-04-01 00:00:00
abstract::In this paper, we propose a simple and straightforward algorithm for neural spike sorting. The algorithm is based on the observation that the distribution of a neural signal largely deviates from the uniform distribution and is rather unimodal. The detected spikes to be sorted are first processed with some feature ext...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/8/6/066014
更新日期:2011-12-01 00:00:00
abstract:OBJECTIVE:Research by Oby et al (2016) demonstrated that the optimal threshold for extracting information from visual and motor cortices may differ from the optimal threshold for identifying single neurons via spike sorting methods. The optimal threshold for extracting information from auditory cortex has yet to be ide...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/ab7c19
更新日期:2020-03-03 00:00:00
abstract:OBJECTIVE:Electrical status epilepticus during sleep (ESES), as electroencephalographic disturbances, is characterized by strong activation of epileptiform activity in the electroencephalogram during sleep. Quantitative descriptors of such epileptiform activity can support the diagnose and the prognosis of children wit...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/aba6dd
更新日期:2020-08-11 00:00:00
abstract::In this work the application of different machine learning techniques for classification of mental tasks from electroencephalograph (EEG) signals is investigated. The main application for this research is the improvement of brain computer interface (BCI) systems. For this purpose, Bayesian graphical network, neural ne...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/3/2/008
更新日期:2006-06-01 00:00:00
abstract:OBJECTIVE:When designing multiclass motor imagery-based brain-computer interface (MI-BCI), a so-called tangent space mapping (TSM) method utilizing the geometric structure of covariance matrices is an effective technique. This paper aims to introduce a method using TSM for finding accurate operational frequency bands r...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/aac313
更新日期:2018-08-01 00:00:00
abstract::This review paper shows that tungsten should not generally be used as a chronically implanted material. The metal has a long implant history, from neuroscience, vascular medicine, radiography, orthopaedics, prosthodontics, and various other fields, primarily as a result of its high density, radiopacity, tensile streng...
journal_title:Journal of neural engineering
pub_type: 杂志文章,评审
doi:10.1088/1741-2552/aaa502
更新日期:2018-04-01 00:00:00
abstract:OBJECTIVE:The goal of this study is to characterize the phenomenon of evoked tactile sensation (ETS) on the stump skin of forearm amputees using transcutaneous electrical nerve stimulation (TENS). APPROACH:We identified the projected finger map (PFM) of ETS on the stump skin in 11 forearm amputees, and compared percep...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/12/6/066002
更新日期:2015-12-01 00:00:00
abstract::The functional effects of selective hypoglossal nerve (HG) stimulation with a multi-contact peripheral nerve electrode were assessed using images of the upper airways and the tongue in anesthetized beagles. A biphasic pulse train of 50 Hz frequency and 2 s duration was applied through each one of the tripolar contact ...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/2/4/002
更新日期:2005-12-01 00:00:00
abstract:OBJECTIVE:Analyzing and interpreting the activity of a heterogeneous population of neurons can be challenging, especially as the number of neurons, experimental trials, and experimental conditions increases. One approach is to extract a set of latent variables that succinctly captures the prominent co-fluctuation patte...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/10/6/066012
更新日期:2013-12-01 00:00:00
abstract::We present a micromachined 252-channel ECoG (electrocorticogram)-electrode array, which is made of a thin polyimide foil substrate enclosing sputtered platinum electrode sites and conductor paths. The array subtends an area of approximately 35 mm by 60 mm and is designed to cover large parts of a hemisphere of a macaq...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/6/3/036003
更新日期:2009-06-01 00:00:00
abstract::We investigated the relationships of the firing rate and maximal recruitment threshold of motoneurons recorded during isometric contraction with the number of spindles in individual muscles. At force levels above 10% of maximal voluntary contraction, the firing rate was inversely related to the number of spindles in a...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/9/1/016007
更新日期:2012-02-01 00:00:00
abstract::To properly observe induced connectivity changes after training sessions, one needs a network model that describes individual relationships in sufficient detail to enable observation of induced changes and yet reveals some kind of stability in these relationships. We analyzed spontaneous firing activity in dissociated...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/4/2/006
更新日期:2007-06-01 00:00:00
abstract:OBJECTIVE:Penetrating cortical neural probe technologies allow investigators to record electrical signals in the brain. Implantation of probes results in acute tissue damage, and microglia density increases around implanted devices over weeks. However, the mechanisms underlying this encapsulation are not well understoo...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/9/6/066001
更新日期:2012-12-01 00:00:00