Performance measurement for brain-computer or brain-machine interfaces: a tutorial.

Abstract:

OBJECTIVE:Brain-computer interfaces (BCIs) have the potential to be valuable clinical tools. However, the varied nature of BCIs, combined with the large number of laboratories participating in BCI research, makes uniform performance reporting difficult. To address this situation, we present a tutorial on performance measurement in BCI research. APPROACH:A workshop on this topic was held at the 2013 International BCI Meeting at Asilomar Conference Center in Pacific Grove, California. This paper contains the consensus opinion of the workshop members, refined through discussion in the following months and the input of authors who were unable to attend the workshop. MAIN RESULTS:Checklists for methods reporting were developed for both discrete and continuous BCIs. Relevant metrics are reviewed for different types of BCI research, with notes on their use to encourage uniform application between laboratories. SIGNIFICANCE:Graduate students and other researchers new to BCI research may find this tutorial a helpful introduction to performance measurement in the field.

journal_name

J Neural Eng

authors

Thompson DE,Quitadamo LR,Mainardi L,Laghari KU,Gao S,Kindermans PJ,Simeral JD,Fazel-Rezai R,Matteucci M,Falk TH,Bianchi L,Chestek CA,Huggins JE

doi

10.1088/1741-2560/11/3/035001

subject

Has Abstract

pub_date

2014-06-01 00:00:00

pages

035001

issue

3

eissn

1741-2560

issn

1741-2552

journal_volume

11

pub_type

杂志文章
  • Stem cells from human exfoliated deciduous teeth differentiate toward neural cells in a medium dynamically cultured with Schwann cells in a series of polydimethylsiloxanes scaffolds.

    abstract:OBJECTIVE:Schwann cells (SCs) are primary structural and functional cells in the peripheral nervous system. These cells play a crucial role in peripheral nerve regeneration by releasing neurotrophic factors. This study evaluated the neural differentiation potential effects of stem cells from human exfoliated deciduous ...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/13/4/046005

    authors: Su WT,Pan YJ

    更新日期:2016-08-01 00:00:00

  • Transducer modeling for accurate acoustic simulations of transcranial focused ultrasound stimulation.

    abstract:OBJECTIVE:Low-intensity transcranial ultrasound stimulation (TUS) is emerging as a non-invasive brain stimulation technique with superior spatial resolution and the ability to reach deep brain areas. Medical image-based computational modeling could be an important tool for individualized TUS dose control and targeting ...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2552/ab98dc

    authors: Pasquinelli C,Montanaro H,Lee HJ,Hanson LG,Kim H,Kuster N,Siebner HR,Neufeld E,Thielscher A

    更新日期:2020-07-13 00:00:00

  • Automatic spike sorting for extracellular electrophysiological recording using unsupervised single linkage clustering based on grey relational analysis.

    abstract::Automatic spike sorting is a prerequisite for neuroscience research on multichannel extracellular recordings of neuronal activity. A novel spike sorting framework, combining efficient feature extraction and an unsupervised clustering method, is described here. Wavelet transform (WT) is adopted to extract features from...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/8/3/036003

    authors: Lai HY,Chen YY,Lin SH,Lo YC,Tsang S,Chen SY,Zhao WT,Chao WH,Chang YC,Wu R,Shih YY,Tsai ST,Jaw FS

    更新日期:2011-06-01 00:00:00

  • The spatial and temporal characteristics of the apparent-diffusion-coefficient-dependent fMRI signal changes during visual stimulation.

    abstract::The blood oxygenation level dependent (BOLD) contrast has been commonly used to detect fMRI signal. The majority of the BOLD signals are believed to arise from the venous and capillary networks. However, only those from the capillaries are spatially close to the neuronal activities, while the signals from large veins ...

    journal_title:Journal of neural engineering

    pub_type: 临床试验,杂志文章

    doi:10.1088/1741-2560/1/1/005

    authors: Song AW,Gangstead SL

    更新日期:2004-03-01 00:00:00

  • Multi-class EEG classification of voluntary hand movement directions.

    abstract:OBJECTIVE:Studies have shown that low frequency components of brain recordings provide information on voluntary hand movement directions. However, non-invasive techniques face more challenges compared to invasive techniques. APPROACH:This study presents a novel signal processing technique to extract features from non-...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/10/5/056018

    authors: Robinson N,Guan C,Vinod AP,Ang KK,Tee KP

    更新日期:2013-10-01 00:00:00

  • Computationally inexpensive enhanced growing neural gas algorithm for real-time adaptive neural spike clustering.

    abstract:OBJECTIVE:Real-time closed-loop neural feedback control requires the analysis of action potential traces within several milliseconds after they have been recorded from the brain. The current generation of spike clustering algorithms were mostly designed for off-line use and also require a significant amount of computat...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2552/ab208c

    authors: Mohammadi Z,Kincaid JM,Pun SH,Klug A,Liu C,Lei TC

    更新日期:2019-07-30 00:00:00

  • An analysis of glutamate spillover on the N-methyl-D-aspartate receptors at the cerebellar glomerulus.

    abstract::Glutamate spillover is thought to play a significant role in increasing neural transmission at the mossy fiber/granule cell cerebellar glomerulus. Glutamate spillover has been shown to activate AMPA receptors at the glomerulus, and here we complete the characterization of spillover at the glomerulus by investigating t...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/4/3/013

    authors: Mitchell CS,Feng SS,Lee RH

    更新日期:2007-09-01 00:00:00

  • Visual cortex responses to suprachoroidal electrical stimulation of the retina: effects of electrode return configuration.

    abstract::A clinically effective retinal prosthesis must evoke localized phosphenes in a retinotopic manner in response to stimulation of each of the retinal electrodes, evoke brightness cues over a wide dynamic range and function within safe stimulus limits. The effects of varying return configuration for retinal stimulation a...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/9/3/036009

    authors: Cicione R,Shivdasani MN,Fallon JB,Luu CD,Allen PJ,Rathbone GD,Shepherd RK,Williams CE

    更新日期:2012-06-01 00:00:00

  • Pavlovian control of intraspinal microstimulation to produce over-ground walking.

    abstract:OBJECTIVE:Neuromodulation technologies are increasingly used for improving function after neural injury. To achieve a symbiotic relationship between device and user, the device must augment remaining function, and independently adapt to day-to-day changes in function. The goal of this study was to develop predictive co...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2552/ab8e8e

    authors: Dalrymple AN,Roszko DA,Sutton RS,Mushahwar VK

    更新日期:2020-06-02 00:00:00

  • Brain-computer interfacing under distraction: an evaluation study.

    abstract:OBJECTIVE:While motor-imagery based brain-computer interfaces (BCIs) have been studied over many years by now, most of these studies have taken place in controlled lab settings. Bringing BCI technology into everyday life is still one of the main challenges in this field of research. APPROACH:This paper systematically ...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/13/5/056012

    authors: Brandl S,Frølich L,Höhne J,Müller KR,Samek W

    更新日期:2016-10-01 00:00:00

  • Probabilistic co-adaptive brain-computer interfacing.

    abstract:OBJECTIVE:Brain-computer interfaces (BCIs) are confronted with two fundamental challenges: (a) the uncertainty associated with decoding noisy brain signals, and (b) the need for co-adaptation between the brain and the interface so as to cooperatively achieve a common goal in a task. We seek to mitigate these challenges...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/10/6/066008

    authors: Bryan MJ,Martin SA,Cheung W,Rao RP

    更新日期:2013-12-01 00:00:00

  • Validating biorobotic models.

    abstract::Some issues in neuroscience can be addressed by building robot models of biological sensorimotor systems. What we can conclude from building models or simulations, however, is determined by a number of factors in addition to the central hypothesis we intend to test. These include the way in which the hypothesis is rep...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章,评审

    doi:10.1088/1741-2560/3/3/R01

    authors: Webb B

    更新日期:2006-09-01 00:00:00

  • Informed consent in implantable BCI research: identification of research risks and recommendations for development of best practices.

    abstract:OBJECTIVE:Implantable brain-computer interface (BCI) research promises improvements in human health and enhancements in quality of life. Informed consent of subjects is a central tenet of this research. Rapid advances in neuroscience, and the intimate connection between functioning of the brain and conceptions of the s...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章,评审

    doi:10.1088/1741-2560/13/4/043001

    authors: Klein E,Ojemann J

    更新日期:2016-08-01 00:00:00

  • A practical guide to methodological considerations in the controllability of structural brain networks.

    abstract:OBJECTIVE:Predicting how the brain can be driven to specific states by means of internal or external control requires a fundamental understanding of the relationship between neural connectivity and activity. Network control theory is a powerful tool from the physical and engineering sciences that can provide insights r...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2552/ab6e8b

    authors: Karrer TM,Kim JZ,Stiso J,Kahn AE,Pasqualetti F,Habel U,Bassett DS

    更新日期:2020-04-09 00:00:00

  • Force estimation from ensembles of Golgi tendon organs.

    abstract::Golgi tendon organs (GTOs) located in the skeletal muscles provide the central nervous system with information about muscle tension. The ensemble firing of all GTO receptors in the muscle has been hypothesized to represent a reliable measure of the whole muscle force but the precision and accuracy of that information ...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/6/3/036001

    authors: Mileusnic MP,Loeb GE

    更新日期:2009-06-01 00:00:00

  • Adaptive neuron-to-EMG decoder training for FES neuroprostheses.

    abstract:OBJECTIVE:We have previously demonstrated a brain-machine interface neuroprosthetic system that provided continuous control of functional electrical stimulation (FES) and restoration of grasp in a primate model of spinal cord injury (SCI). Predicting intended EMG directly from cortical recordings provides a flexible hi...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/13/4/046009

    authors: Ethier C,Acuna D,Solla SA,Miller LE

    更新日期:2016-08-01 00:00:00

  • Suppression of scarring in peripheral nerve implants by drug elution.

    abstract:OBJECTIVE:Medical implants made of non-biological materials provoke a chronic inflammatory response, resulting in the deposition of a collagenous scar tissue (ST) layer on their surface, that gradually thickens over time. This is a critical problem for neural interfaces. Scar build-up on electrodes results in a progres...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/13/2/026006

    authors: FitzGerald JJ

    更新日期:2016-04-01 00:00:00

  • In vivo two-photon microscopy reveals immediate microglial reaction to implantation of microelectrode through extension of processes.

    abstract:OBJECTIVE:Penetrating cortical neural probe technologies allow investigators to record electrical signals in the brain. Implantation of probes results in acute tissue damage, and microglia density increases around implanted devices over weeks. However, the mechanisms underlying this encapsulation are not well understoo...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/9/6/066001

    authors: Kozai TD,Vazquez AL,Weaver CL,Kim SG,Cui XT

    更新日期:2012-12-01 00:00:00

  • P300-based brain-computer interface for environmental control: an asynchronous approach.

    abstract::Brain-computer interface (BCI) systems allow people with severe motor disabilities to communicate and interact with the external world. The P300 potential is one of the most used control signals for EEG-based BCIs. Classic P300-based BCIs work in a synchronous mode; the synchronous control assumes that the user is con...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/8/2/025025

    authors: Aloise F,Schettini F,Aricò P,Leotta F,Salinari S,Mattia D,Babiloni F,Cincotti F

    更新日期:2011-04-01 00:00:00

  • An intra-operative feature-based classification of microelectrode recordings to support the subthalamic nucleus functional identification during deep brain stimulation surgery.

    abstract:OBJECTIVE:The Subthalamic Nucleus (STN) is the most selected target for the placement of the Deep Brain Stimulation (DBS) electrode to treat Parkinson's disease. Its identification is a delicate and challenging task which is based on the interpretation of the STN functional activity acquired through microelectrode reco...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2552/abcb15

    authors: Coelli S,Levi V,Del Vecchio Del Vecchio J,Mailland E,Rinaldo S,Eleopra R,Bianchi AM

    更新日期:2020-11-17 00:00:00

  • Assessing altered motor unit recruitment patterns in paretic muscles of stroke survivors using surface electromyography.

    abstract:OBJECTIVE:The advancement of surface electromyogram (sEMG) recording and signal processing techniques has allowed us to characterize the recruitment properties of a substantial population of motor units (MUs) non-invasively. Here we seek to determine whether MU recruitment properties are modified in paretic muscles of ...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/12/6/066001

    authors: Hu X,Suresh AK,Rymer WZ,Suresh NL

    更新日期:2015-12-01 00:00:00

  • Multiband tangent space mapping and feature selection for classification of EEG during motor imagery.

    abstract:OBJECTIVE:When designing multiclass motor imagery-based brain-computer interface (MI-BCI), a so-called tangent space mapping (TSM) method utilizing the geometric structure of covariance matrices is an effective technique. This paper aims to introduce a method using TSM for finding accurate operational frequency bands r...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2552/aac313

    authors: Islam MR,Tanaka T,Molla MKI

    更新日期:2018-08-01 00:00:00

  • Ultraminiaturized photovoltaic and radio frequency powered optoelectronic systems for wireless optogenetics.

    abstract:OBJECTIVE:Wireless control and power harvesting systems that operate injectable, cellular-scale optoelectronic components provide important demonstrated capabilities in neuromodulatory techniques such as optogenetics. Here, we report a radio frequency (RF) control/harvesting device that offers dramatically reduced size...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/12/5/056002

    authors: Park SI,Shin G,Banks A,McCall JG,Siuda ER,Schmidt MJ,Chung HU,Noh KN,Mun JG,Rhodes J,Bruchas MR,Rogers JA

    更新日期:2015-10-01 00:00:00

  • Conditional firing probabilities in cultured neuronal networks: a stable underlying structure in widely varying spontaneous activity patterns.

    abstract::To properly observe induced connectivity changes after training sessions, one needs a network model that describes individual relationships in sufficient detail to enable observation of induced changes and yet reveals some kind of stability in these relationships. We analyzed spontaneous firing activity in dissociated...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/4/2/006

    authors: le Feber J,Rutten WL,Stegenga J,Wolters PS,Ramakers GJ,van Pelt J

    更新日期:2007-06-01 00:00:00

  • A novel flexible cuff-like microelectrode for dual purpose, acute and chronic electrical interfacing with the mouse cervical vagus nerve.

    abstract:OBJECTIVE:Neural reflexes regulate immune responses and homeostasis. Advances in bioelectronic medicine indicate that electrical stimulation of the vagus nerve can be used to treat inflammatory disease, yet the understanding of neural signals that regulate inflammation is incomplete. Current interfaces with the vagus n...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2552/aa7a42

    authors: Caravaca AS,Tsaava T,Goldman L,Silverman H,Riggott G,Chavan SS,Bouton C,Tracey KJ,Desimone R,Boyden ES,Sohal HS,Olofsson PS

    更新日期:2017-12-01 00:00:00

  • A Correlation-Driven Mapping For Deep Learning application in detecting artifacts within the EEG.

    abstract:OBJECTIVE:When developing approaches for automatic preprocessing of electroencephalogram (EEG) signals in non-isolated demanding environment such as intensive care unit (ICU) or even outdoor environment, one of the major concerns is varying nature of characteristics of different artifacts in time, frequency and spatial...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2552/abb5bd

    authors: Bahador N,Erikson K,Laurila J,Koskenkari J,Ala-Kokko T,Kortelainen J

    更新日期:2020-10-15 00:00:00

  • A combination strategy based brain-computer interface for two-dimensional movement control.

    abstract:OBJECTIVE:Two-dimensional (2D) movement control is an important issue in brain-computer interfaces (BCIs) research because being able to move, for example, a cursor with the brain will enable patients with motor disabilities to control their environment. However, it is still a challenge to continuously control 2D movem...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/12/4/046021

    authors: Xia B,Maysam O,Veser S,Cao L,Li J,Jia J,Xie H,Birbaumer N

    更新日期:2015-08-01 00:00:00

  • Characterization of evoked tactile sensation in forearm amputees with transcutaneous electrical nerve stimulation.

    abstract:OBJECTIVE:The goal of this study is to characterize the phenomenon of evoked tactile sensation (ETS) on the stump skin of forearm amputees using transcutaneous electrical nerve stimulation (TENS). APPROACH:We identified the projected finger map (PFM) of ETS on the stump skin in 11 forearm amputees, and compared percep...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/12/6/066002

    authors: Chai G,Sui X,Li S,He L,Lan N

    更新日期:2015-12-01 00:00:00

  • Within-socket myoelectric prediction of continuous ankle kinematics for control of a powered transtibial prosthesis.

    abstract:OBJECTIVE:Powered robotic prostheses create a need for natural-feeling user interfaces and robust control schemes. Here, we examined the ability of a nonlinear autoregressive model to continuously map the kinematics of a transtibial prosthesis and electromyographic (EMG) activity recorded within socket to the future es...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2560/11/5/056027

    authors: Farmer S,Silver-Thorn S,Voglewede P,Beardsley SA

    更新日期:2014-10-01 00:00:00

  • Biophysically realistic neuron models for simulation of cortical stimulation.

    abstract:OBJECTIVE:We implemented computational models of human and rat cortical neurons for simulating the neural response to cortical stimulation with electromagnetic fields. APPROACH:We adapted model neurons from the library of Blue Brain models to reflect biophysical and geometric properties of both adult rat and human cor...

    journal_title:Journal of neural engineering

    pub_type: 杂志文章

    doi:10.1088/1741-2552/aadbb1

    authors: Aberra AS,Peterchev AV,Grill WM

    更新日期:2018-12-01 00:00:00