Abstract:
OBJECTIVE:Brain-computer interfaces (BCIs) are confronted with two fundamental challenges: (a) the uncertainty associated with decoding noisy brain signals, and (b) the need for co-adaptation between the brain and the interface so as to cooperatively achieve a common goal in a task. We seek to mitigate these challenges. APPROACH:We introduce a new approach to brain-computer interfacing based on partially observable Markov decision processes (POMDPs). POMDPs provide a principled approach to handling uncertainty and achieving co-adaptation in the following manner: (1) Bayesian inference is used to compute posterior probability distributions ('beliefs') over brain and environment state, and (2) actions are selected based on entire belief distributions in order to maximize total expected reward; by employing methods from reinforcement learning, the POMDP's reward function can be updated over time to allow for co-adaptive behaviour. MAIN RESULTS:We illustrate our approach using a simple non-invasive BCI which optimizes the speed-accuracy trade-off for individual subjects based on the signal-to-noise characteristics of their brain signals. We additionally demonstrate that the POMDP BCI can automatically detect changes in the user's control strategy and can co-adaptively switch control strategies on-the-fly to maximize expected reward. SIGNIFICANCE:Our results suggest that the framework of POMDPs offers a promising approach for designing BCIs that can handle uncertainty in neural signals and co-adapt with the user on an ongoing basis. The fact that the POMDP BCI maintains a probability distribution over the user's brain state allows a much more powerful form of decision making than traditional BCI approaches, which have typically been based on the output of classifiers or regression techniques. Furthermore, the co-adaptation of the system allows the BCI to make online improvements to its behaviour, adjusting itself automatically to the user's changing circumstances.
journal_name
J Neural Engjournal_title
Journal of neural engineeringauthors
Bryan MJ,Martin SA,Cheung W,Rao RPdoi
10.1088/1741-2560/10/6/066008subject
Has Abstractpub_date
2013-12-01 00:00:00pages
066008issue
6eissn
1741-2560issn
1741-2552journal_volume
10pub_type
杂志文章abstract::Adaptive model theory (AMT) is a computational theory that addresses the difficult control problem posed by the musculoskeletal system in interaction with the environment. It proposes that the nervous system creates motor maps and task-dependent synergies to solve the problems of redundancy and limited central resourc...
journal_title:Journal of neural engineering
pub_type: 杂志文章,评审
doi:10.1088/1741-2560/2/3/S10
更新日期:2005-09-01 00:00:00
abstract::Significant progress has been made in systems that interpret the electrical signals of the brain in order to control an actuator. One version of these systems senses neuronal extracellular action potentials with an array of up to 100 miniature probes inserted into the cortex. The impedance of each probe is high, so en...
journal_title:Journal of neural engineering
pub_type: 杂志文章,评审
doi:10.1088/1741-2560/6/1/012001
更新日期:2009-02-01 00:00:00
abstract:OBJECTIVE:Two-dimensional (2D) movement control is an important issue in brain-computer interfaces (BCIs) research because being able to move, for example, a cursor with the brain will enable patients with motor disabilities to control their environment. However, it is still a challenge to continuously control 2D movem...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/12/4/046021
更新日期:2015-08-01 00:00:00
abstract:OBJECTIVE:Intracortical brain-machine interfaces (iBMIs) aim to restore efficient communication and movement ability for paralyzed patients. However, frequent recalibration is required for consistency and reliability, and every recalibration will require relatively large most current sample set. The aim in this study i...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/aaa8a4
更新日期:2018-04-01 00:00:00
abstract:OBJECTIVE:We have recently developed a prototype of a novel human-computer interface for assistive communication based on voluntary shifts of attention (gaze) from a far target to a near target associated with a decrease of pupil size (Pupillary Accommodative Response, PAR), an automatic vegetative response that can be...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/ab8e8f
更新日期:2020-04-29 00:00:00
abstract:OBJECTIVE:Multiresolution analysis (MRA) offers a useful framework for signal analysis in the temporal and spectral domains, although commonly employed MRA methods may not be the best approach for brain computer interface (BCI) applications. This study aims to develop a new MRA system for extracting tempo-spatial-spect...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/10/4/046014
更新日期:2013-08-01 00:00:00
abstract::In models of electrical stimulation of the nervous system, the electric potential is typically calculated using the quasi-static approximation. The quasi-static approximation allows Maxwell's equations to be simplified by ignoring capacitive, inductive and wave propagation contributions to the potential. While this si...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/5/1/005
更新日期:2008-03-01 00:00:00
abstract:UNLABELLED:Transcranial Doppler (TCD) was recently introduced as a new brain-computer interface (BCI) modality for detecting task-induced hemispheric lateralization. To date, single-trial discrimination between a lateralized mental activity and a rest state has been demonstrated with long (45 s) activation time periods...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/10/1/016005
更新日期:2013-02-01 00:00:00
abstract::One of the most important stages in a brain-computer interface (BCI) system is that of extracting features that can reliably discriminate data recorded during different user states. A popular technique used for feature extraction in BCIs is the common spatial patterns (CSP) method, which provides a set of spatial filt...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/9/4/045009
更新日期:2012-08-01 00:00:00
abstract::In this work the application of different machine learning techniques for classification of mental tasks from electroencephalograph (EEG) signals is investigated. The main application for this research is the improvement of brain computer interface (BCI) systems. For this purpose, Bayesian graphical network, neural ne...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/3/2/008
更新日期:2006-06-01 00:00:00
abstract:OBJECTIVE:The Subthalamic Nucleus (STN) is the most selected target for the placement of the Deep Brain Stimulation (DBS) electrode to treat Parkinson's disease. Its identification is a delicate and challenging task which is based on the interpretation of the STN functional activity acquired through microelectrode reco...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/abcb15
更新日期:2020-11-17 00:00:00
abstract::We investigated the relationships of the firing rate and maximal recruitment threshold of motoneurons recorded during isometric contraction with the number of spindles in individual muscles. At force levels above 10% of maximal voluntary contraction, the firing rate was inversely related to the number of spindles in a...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/9/1/016007
更新日期:2012-02-01 00:00:00
abstract:OBJECTIVE:Sleep spindles in the electroencephalogram (EEG) are significant in sleep analysis related to cognitive functions and neurological diseases, and thus are of great clinical interests. An automatic sleep spindle detection algorithm could help decrease the workload of visual inspection by sleep clinicians. APPR...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/abd463
更新日期:2020-12-16 00:00:00
abstract:OBJECTIVE:It is known that multi-site interleaved stimulation generates less muscle fatigue compared to single-site synchronous stimulation. However, in the limited number of studies in which intramuscular electrodes were used, the fatigue reduction associated with interleaved stimulation could not consistently be achi...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/aba99e
更新日期:2020-08-25 00:00:00
abstract:OBJECTIVE:Real-time closed-loop neural feedback control requires the analysis of action potential traces within several milliseconds after they have been recorded from the brain. The current generation of spike clustering algorithms were mostly designed for off-line use and also require a significant amount of computat...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/ab208c
更新日期:2019-07-30 00:00:00
abstract::The functional effects of selective hypoglossal nerve (HG) stimulation with a multi-contact peripheral nerve electrode were assessed using images of the upper airways and the tongue in anesthetized beagles. A biphasic pulse train of 50 Hz frequency and 2 s duration was applied through each one of the tripolar contact ...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/2/4/002
更新日期:2005-12-01 00:00:00
abstract::Golgi tendon organs (GTOs) located in the skeletal muscles provide the central nervous system with information about muscle tension. The ensemble firing of all GTO receptors in the muscle has been hypothesized to represent a reliable measure of the whole muscle force but the precision and accuracy of that information ...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/6/3/036001
更新日期:2009-06-01 00:00:00
abstract:OBJECTIVE:Most recent steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) systems have used a single frequency for each target, so that a large number of targets require a large number of stimulus frequencies and therefore a wider frequency band. However, human beings show good SSVEP respo...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/10/6/066009
更新日期:2013-12-01 00:00:00
abstract::This paper describes the technological developments underlying the realization of a reliable and reproducible microchip-based stimulator with a large number of stimulus electrodes. A microchip-based stimulator with over 500 electrodes for suprachoroidal transretinal stimulation (STS) is proposed in this paper, and an ...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/4/1/S10
更新日期:2007-03-01 00:00:00
abstract:OBJECTIVE:Recording of neural signals from intact peripheral nerves in patients with spinal cord injury or stroke survivors offers the possibility for the development of closed-loop sensorimotor prostheses. Nerve cuffs have been found to provide stable recordings from peripheral nerves for prolonged periods of time. Ho...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/aabca0
更新日期:2018-08-01 00:00:00
abstract:OBJECTIVE:Neuromodulation technologies are increasingly used for improving function after neural injury. To achieve a symbiotic relationship between device and user, the device must augment remaining function, and independently adapt to day-to-day changes in function. The goal of this study was to develop predictive co...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/ab8e8e
更新日期:2020-06-02 00:00:00
abstract:OBJECTIVE:The various parameters that define a hand movement such as its trajectory, speed, etc, are encoded in distinct brain activities. Decoding this information from neurophysiological recordings is a less explored area of brain-computer interface (BCI) research. Applying non-invasive recordings such as electroence...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/12/6/066019
更新日期:2015-12-01 00:00:00
abstract:OBJECTIVE:Spike detection from extracellular recordings is a crucial preprocessing step when analyzing neuronal activity. The decision whether a specific part of the signal is a spike or not is important for any kind of other subsequent preprocessing steps, like spike sorting or burst detection in order to reduce the c...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/aa654b
更新日期:2017-06-01 00:00:00
abstract:OBJECTIVE:Electrical status epilepticus during sleep (ESES), as electroencephalographic disturbances, is characterized by strong activation of epileptiform activity in the electroencephalogram during sleep. Quantitative descriptors of such epileptiform activity can support the diagnose and the prognosis of children wit...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/aba6dd
更新日期:2020-08-11 00:00:00
abstract::This comment constitutes a re-assessment of a recent study in which near-infrared spectroscopy (NIRS) was used to decode decision making. In the original study, the process of feature selection was carried out on all of the data, and those features which displayed the greater classification accuracy were selected, but...
journal_title:Journal of neural engineering
pub_type: 评论,杂志文章
doi:10.1088/1741-2560/6/5/058001
更新日期:2009-10-01 00:00:00
abstract:OBJECTIVE:Functions ascribed to the hippocampal sub-regions for encoding episodic memories include the separation of activity patterns propagated from the entorhinal cortex (EC) into the dentate gyrus (DG) and pattern completion in CA3 region. Since a direct assessment of these functions is lacking at the level of spec...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/aabc20
更新日期:2018-08-01 00:00:00
abstract::This review paper shows that tungsten should not generally be used as a chronically implanted material. The metal has a long implant history, from neuroscience, vascular medicine, radiography, orthopaedics, prosthodontics, and various other fields, primarily as a result of its high density, radiopacity, tensile streng...
journal_title:Journal of neural engineering
pub_type: 杂志文章,评审
doi:10.1088/1741-2552/aaa502
更新日期:2018-04-01 00:00:00
abstract:OBJECTIVE:To determine whether the estimated fraction and degree of distribution of visual responsive neurons in human intracranial microwire recordings depends upon the spike sorting method used. APPROACH:A large dataset of human intracranial microwire recordings from four brain areas was sorted into single unit acti...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/ab6cb8
更新日期:2020-04-09 00:00:00
abstract:OBJECTIVE:Although electrode size should be miniaturized to provide higher selectivity for neural signal recording and to avoid tissue damage, small sized electrodes induce high impedance, which decreases recording quality. In this work, the electrode surface was modified to increase the effective surface area to lower...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2560/12/5/056018
更新日期:2015-10-01 00:00:00
abstract:OBJECTIVE:Intracranial EEG (iEEG) or micro-electrocorticography (µECoG) microelectrodes offer high spatial resolution in recordings of neuronal activity from the exposed brain surface. Reliability of dielectric substrates and conductive materials of these devices are under intensive research in terms of functional stab...
journal_title:Journal of neural engineering
pub_type: 杂志文章
doi:10.1088/1741-2552/aacf71
更新日期:2018-10-01 00:00:00