A Novel Audiovisual P300-Speller Paradigm Based on Cross-Modal Spatial and Semantic Congruence.

Abstract:

Objective:Although many studies have attempted to improve the performance of the visual-based P300-speller system, its performance is still not satisfactory. The current system has limitations for patients with neurodegenerative diseases, in which muscular control of the eyes may be impaired or deteriorate over time. Some studies have shown that the audiovisual stimuli with spatial and semantic congruence elicited larger event-related potential (ERP) amplitudes than do unimodal visual stimuli. Therefore, this study proposed a novel multisensory P300-speller based on audiovisual spatial and semantic congruence. Methods:We designed a novel audiovisual P300-speller paradigm (AV spelling paradigm) in which the pronunciation and visual presentation of characters were matched in spatial position and semantics. We analyzed the ERP waveforms elicited in the AV spelling paradigm and visual-based spelling paradigm (V spelling paradigm) and compared the classification accuracies between these two paradigms. Results:ERP analysis revealed significant differences in ERP amplitudes between the two paradigms in the following areas (AV > V): the frontal area at 60-140 ms, frontal-central-parietal area at 360-460 ms, frontal area at 700-800 ms, right temporal area at 380-480 and 700-780 ms, and left temporal area at 500-780 ms. Offline classification results showed that the accuracies were significantly higher in the AV spelling paradigm than in the V spelling paradigm after superposing 1, 2, 5, 6, 9, and 10 times (P < 0.05), and there were trends toward improvement in the accuracies at superposing 3, 4, 7, and 8 times (P = 0.06). Similar results were found for information transfer rate between V and AV spelling paradigms at 1, 2, 5, 6, and 10 superposition times (P < 0.05). Significance:The proposed audiovisual P300-speller paradigm significantly improved the classification accuracies compared with the visual-based P300-speller paradigm. Our novel paradigm combines spatial and semantic features of two sensory modalities, and the present findings provide valuable insights into the development of multimodal ERP-based BCI paradigms.

journal_name

Front Neurosci

authors

Lu Z,Li Q,Gao N,Yang J,Bai O

doi

10.3389/fnins.2019.01040

subject

Has Abstract

pub_date

2019-09-27 00:00:00

pages

1040

eissn

1662-4548

issn

1662-453X

journal_volume

13

pub_type

杂志文章
  • Natural Diterpenoid Oridonin Ameliorates Experimental Autoimmune Neuritis by Promoting Anti-inflammatory Macrophages Through Blocking Notch Pathway.

    abstract::The diterpenoid compound, Oridonin, extracted from the Chinese herb, Rabdosia rubescens, possesses multiple biological activities and properties. Oridonin exhibited efficient anti-inflammatory activity by inducing a switch in macrophage polarization to the anti-inflammatory phenotype through inhibition of the Notch pa...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00272

    authors: Xu L,Li L,Zhang CY,Schluesener H,Zhang ZY

    更新日期:2019-04-02 00:00:00

  • Modeling Pitch Perception With an Active Auditory Model Extended by Octopus Cells.

    abstract::Pitch is an essential category for musical sensations. Models of pitch perception are vividly discussed up to date. Most of them rely on definitions of mathematical methods in the spectral or temporal domain. Our proposed pitch perception model is composed of an active auditory model extended by octopus cells. The act...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00660

    authors: Harczos T,Klefenz FM

    更新日期:2018-09-25 00:00:00

  • Secretory function in subplate neurons during cortical development.

    abstract::Subplate cells are among the first generated neurons in the mammalian cerebral cortex and have been implicated in the establishment of cortical wiring. In rodents some subplate neurons persist into adulthood. Here we would like to highlight several converging findings which suggest a novel secretory function of subpla...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2015.00100

    authors: Kondo S,Al-Hasani H,Hoerder-Suabedissen A,Wang WZ,Molnár Z

    更新日期:2015-03-26 00:00:00

  • STDP and STDP variations with memristors for spiking neuromorphic learning systems.

    abstract::In this paper we review several ways of realizing asynchronous Spike-Timing-Dependent-Plasticity (STDP) using memristors as synapses. Our focus is on how to use individual memristors to implement synaptic weight multiplications, in a way such that it is not necessary to (a) introduce global synchronization and (b) to ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2013.00002

    authors: Serrano-Gotarredona T,Masquelier T,Prodromakis T,Indiveri G,Linares-Barranco B

    更新日期:2013-02-18 00:00:00

  • Decoding Speech With Integrated Hybrid Signals Recorded From the Human Ventral Motor Cortex.

    abstract::Restoration of speech communication for locked-in patients by means of brain computer interfaces (BCIs) is currently an important area of active research. Among the neural signals obtained from intracranial recordings, single/multi-unit activity (SUA/MUA), local field potential (LFP), and electrocorticography (ECoG) a...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00221

    authors: Ibayashi K,Kunii N,Matsuo T,Ishishita Y,Shimada S,Kawai K,Saito N

    更新日期:2018-04-05 00:00:00

  • Decreased Functional Connectivity Between the Right Precuneus and Middle Frontal Gyrus Is Related to Attentional Decline Following Acute Sleep Deprivation.

    abstract:Objectives:Acute sleep deprivation (SD) seriously affects cognitive functions, such as attention, memory, and response inhibition. Previous neuroimaging studies have demonstrated a close relationship between the functional activities of the precuneus (PC) and the function of alert attention. However, the specific effec...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.530257

    authors: Li B,Zhang L,Zhang Y,Chen Y,Peng J,Shao Y,Zhang X

    更新日期:2020-12-21 00:00:00

  • The Current State-of-the Art of LRRK2-Based Biomarker Assay Development in Parkinson's Disease.

    abstract::Evidence is mounting that LRRK2 function, particularly its kinase activity, is elevated in multiple forms of Parkinson's disease, both idiopathic as well as familial forms linked to mutations in the LRRK2 gene. However, sensitive quantitative markers of LRRK2 activation in clinical samples remain at the early stages o...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2020.00865

    authors: Rideout HJ,Chartier-Harlin MC,Fell MJ,Hirst WD,Huntwork-Rodriguez S,Leyns CEG,Mabrouk OS,Taymans JM

    更新日期:2020-08-18 00:00:00

  • Benchmarking neuromorphic vision: lessons learnt from computer vision.

    abstract::Neuromorphic Vision sensors have improved greatly since the first silicon retina was presented almost three decades ago. They have recently matured to the point where they are commercially available and can be operated by laymen. However, despite improved availability of sensors, there remains a lack of good datasets,...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2015.00374

    authors: Tan C,Lallee S,Orchard G

    更新日期:2015-10-13 00:00:00

  • A Spiking Neural Network Model of the Lateral Geniculate Nucleus on the SpiNNaker Machine.

    abstract::We present a spiking neural network model of the thalamic Lateral Geniculate Nucleus (LGN) developed on SpiNNaker, which is a state-of-the-art digital neuromorphic hardware built with very-low-power ARM processors. The parallel, event-based data processing in SpiNNaker makes it viable for building massively parallel n...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00454

    authors: Sen-Bhattacharya B,Serrano-Gotarredona T,Balassa L,Bhattacharya A,Stokes AB,Rowley A,Sugiarto I,Furber S

    更新日期:2017-08-09 00:00:00

  • Cytoplasmic dynein and its regulatory proteins in Golgi pathology in nervous system disorders.

    abstract::The Golgi apparatus is a dynamic organelle involved in processing and sorting of lipids and proteins. In neurons, the Golgi apparatus is important for the development of axons and dendrites and maintenance of their highly complex polarized morphology. The motor protein complex cytoplasmic dynein has an important role ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2015.00397

    authors: Jaarsma D,Hoogenraad CC

    更新日期:2015-10-26 00:00:00

  • Explaining Individual Differences in Motor Behavior by Intrinsic Functional Connectivity and Corticospinal Excitability.

    abstract::Motor performance varies substantially between individuals. This variance is rooted in individuals' innate motor abilities, and should thus have a neural signature underlying these differences in behavior. Could these individual differences be detectable with neural measurements acquired at rest? Here, we tested the h...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00076

    authors: Herszage J,Dayan E,Sharon H,Censor N

    更新日期:2020-02-05 00:00:00

  • Detection of DNA Double Strand Breaks by γH2AX Does Not Result in 53bp1 Recruitment in Mouse Retinal Tissues.

    abstract::Gene editing is an attractive potential treatment of inherited retinopathies. However, it often relies on endogenous DNA repair. Retinal DNA repair is incompletely characterized in humans and animal models. We investigated recruitment of the double stranded break (DSB) repair complex of γH2AX and 53bp1 in both develop...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00286

    authors: Müller B,Ellinwood NM,Lorenz B,Stieger K

    更新日期:2018-05-01 00:00:00

  • Heart Rate Variability Predicts Therapeutic Response to Metoprolol in Children With Postural Tachycardia Syndrome.

    abstract:Purpose:To improve the metoprolol therapeutic effectiveness, we aimed to explore whether baseline heart rate variability (HRV) indicators before metoprolol treatment were useful for predicting its efficacy for postural tachycardia syndrome (POTS). Methods:We recruited 45 children with POTS who received metoprolol and ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.01214

    authors: Wang Y,Zhang C,Chen S,Liu P,Wang Y,Tang C,Jin H,Du J

    更新日期:2019-11-12 00:00:00

  • Experimental and Computational Methods for the Study of Cerebral Organoids: A Review.

    abstract::Cerebral (or brain) organoids derived from human cells have enormous potential as physiologically relevant downscaled in vitro models of the human brain. In fact, these stem cell-derived neural aggregates resemble the three-dimensional (3D) cytoarchitectural arrangement of the brain overcoming not only the unrealistic...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2019.00162

    authors: Poli D,Magliaro C,Ahluwalia A

    更新日期:2019-03-05 00:00:00

  • Automatic Segmentation of Corpus Callosum in Midsagittal Based on Bayesian Inference Consisting of Sparse Representation Error and Multi-Atlas Voting.

    abstract::In this paper, we introduce a novel automatic method for Corpus Callosum (CC) in midsagittal plane segmentation. The robust segmentation of CC in midsagittal plane is key role for quantitative study of structural features of CC associated with various neurological disorder such as epilepsy, autism, Alzheimer's disease...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00629

    authors: Park G,Kwak K,Seo SW,Lee JM

    更新日期:2018-09-11 00:00:00

  • Design of an Adaptive Human-Machine System Based on Dynamical Pattern Recognition of Cognitive Task-Load.

    abstract::This paper developed a cognitive task-load (CTL) classification algorithm and allocation strategy to sustain the optimal operator CTL levels over time in safety-critical human-machine integrated systems. An adaptive human-machine system is designed based on a non-linear dynamic CTL classifier, which maps a set of elec...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00129

    authors: Zhang J,Yin Z,Wang R

    更新日期:2017-03-17 00:00:00

  • Effects of Noise on the Behavioral and Neural Categorization of Speech.

    abstract::We investigated whether the categorical perception (CP) of speech might also provide a mechanism that aids its perception in noise. We varied signal-to-noise ratio (SNR) [clear, 0 dB, -5 dB] while listeners classified an acoustic-phonetic continuum (/u/ to /a/). Noise-related changes in behavioral categorization were ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00153

    authors: Bidelman GM,Bush LC,Boudreaux AM

    更新日期:2020-02-27 00:00:00

  • Gender-typical olfactory regulation of sexual behavior in goldfish.

    abstract::It is known that olfaction is essential for the occurrence of sexual behavior in male goldfish. Sex pheromones from ovulatory females elicit male sexual behavior, chasing, and sperm releasing act. In female goldfish, ovarian prostaglandin F2α (PGF) elicits female sexual behavior, egg releasing act. It has been conside...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2014.00091

    authors: Kawaguchi Y,Nagaoka A,Kitami A,Mitsuhashi T,Hayakawa Y,Kobayashi M

    更新日期:2014-04-30 00:00:00

  • The Role of MicroRNA in the Modulation of the Melanocortinergic System.

    abstract::The central control of energy balance involves a highly regulated neuronal network within the hypothalamus and the dorsal vagal complex. In these structures, pro-opiomelanocortin (POMC) neurons are known to reduce meal size and to increase energy expenditure. In addition, leptin, a peripheral signal that relays inform...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2017.00181

    authors: Derghal A,Djelloul M,Trouslard J,Mounien L

    更新日期:2017-04-05 00:00:00

  • Electrophysiological characterization of male goldfish (Carassius auratus) ventral preoptic area neurons receiving olfactory inputs.

    abstract::Chemical communication via sex pheromones is critical for successful reproduction but the underlying neural mechanisms are not well-understood. The goldfish is a tractable model because sex pheromones have been well-characterized in this species. We used male goldfish forebrain explants in vitro and performed whole-ce...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2014.00185

    authors: Lado WE,Spanswick DC,Lewis JE,Trudeau VL

    更新日期:2014-06-30 00:00:00

  • Pharmaco-fUS for Characterizing Drugs for Alzheimer's Disease - The Case of THN201, a Drug Combination of Donepezil Plus Mefloquine.

    abstract::Donepezil is a potent acetylcholinesterase inhibitor, largely used worldwide to alleviate cognitive symptoms in Alzheimer's disease (AD). Beyond the widely described neuronal impact of donepezil, it was recently shown that targeting connexins, the proteins involved in astrocyte network organization, potentiates donepe...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00835

    authors: Vidal B,Droguerre M,Valdebenito M,Zimmer L,Hamon M,Mouthon F,Charvériat M

    更新日期:2020-08-12 00:00:00

  • No Effect of Transcranial Direct Current Stimulation of the Auditory Cortex on Auditory-Evoked Potentials.

    abstract::Transcranial direct current stimulation (tDCS) is a non-invasive brain stimulation technique to change cortical excitability. Its effects are shown for cognitive processing, and behavior in the motor and perceptual domains. However, evidence of tDCS effects in the perceptual domain particularly for auditory processing...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00880

    authors: Kunzelmann K,Meier L,Grieder M,Morishima Y,Dierks T

    更新日期:2018-11-27 00:00:00

  • Therapeutic potential of mGluR5 targeting in Alzheimer's disease.

    abstract::Decades of research dedicated toward Alzheimer's disease (AD) has culminated in much of the current understanding of the neurodegeneration associated with disease. However, delineating the pathophysiology and finding a possible cure for the disease is still wanting. This is in part due to the lack of knowledge pertain...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2015.00215

    authors: Kumar A,Dhull DK,Mishra PS

    更新日期:2015-06-09 00:00:00

  • Quantitative Profiling of Oxylipins in Acute Experimental Intracerebral Hemorrhage.

    abstract::Oxylipins are a series of bioactive lipid metabolites derived from polyunsaturated fatty acids that are involved in cerebral homeostasis and the development of intracerebral hemorrhage (ICH). However, comprehensive quantification of the oxylipin profile in ICH remains unknown. Therefore, an ICH mouse model was constru...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00777

    authors: Yuan JJ,Chen Q,Xiong XY,Zhang Q,Xie Q,Huang JC,Yang GQ,Gong CX,Qiu ZM,Sang HF,Zi WJ,He Q,Xu R,Yang QW

    更新日期:2020-09-23 00:00:00

  • Menstrual cycle influence on cognitive function and emotion processing-from a reproductive perspective.

    abstract::The menstrual cycle has attracted research interest ever since the 1930s. For many researchers the menstrual cycle is an excellent model of ovarian steroid influence on emotion, behavior, and cognition. Over the past years methodological improvements in menstrual cycle studies have been noted, and this review summariz...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2014.00380

    authors: Sundström Poromaa I,Gingnell M

    更新日期:2014-11-24 00:00:00

  • Modulation of Illusory Auditory Perception by Transcranial Electrical Stimulation.

    abstract::The aim of the present study was to test whether transcranial electrical stimulation can modulate illusory perception in the auditory domain. In two separate experiments we applied transcranial Direct Current Stimulation (anodal/cathodal tDCS, 2 mA; N = 60) and high-frequency transcranial Random Noise Stimulation (hf-...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00351

    authors: Prete G,D'Anselmo A,Tommasi L,Brancucci A

    更新日期:2017-06-20 00:00:00

  • Exposure in vivo Induced Changes in Neural Circuitry for Pain-Related Fear: A Longitudinal fMRI Study in Chronic Low Back Pain.

    abstract::Exposure in vivo (EXP) is a cognitive-behavioral treatment aimed at reducing pain-related fear in chronic pain, and has proven successful in reducing pain-related disability in patients with chronic low back pain (cLBP). The current longitudinal study aimed to reveal the neural correlates of changes in pain-related fe...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00970

    authors: Timmers I,de Jong JR,Goossens M,Verbunt JA,Smeets RJ,Kaas AL

    更新日期:2019-09-17 00:00:00

  • Three Research Strategies of Neuroscience and the Future of Legal Imaging Evidence.

    abstract::Neuroscientific imaging evidence (NIE) has become an integral part of the criminal justice system in the United States. However, in most legal cases, NIE is submitted and used only to mitigate penalties because the court does not recognize it as substantial evidence, considering its lack of reliability. Nevertheless, ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00120

    authors: Jun J,Yoo S

    更新日期:2018-03-01 00:00:00

  • Synergy and Antagonism of Active Constituents of ADAPT-232 on Transcriptional Level of Metabolic Regulation of Isolated Neuroglial Cells.

    abstract::Gene expression profiling was performed on the human neuroglial cell line T98G after treatment with adaptogen ADAPT-232 and its constituents - extracts of Eleutherococcus senticosus root, Schisandra chinensis berry, and Rhodiola rosea root as well as several constituents individually, namely, eleutheroside E, schizand...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2013.00016

    authors: Panossian A,Hamm R,Kadioglu O,Wikman G,Efferth T

    更新日期:2013-02-20 00:00:00

  • Habenula circuit development: past, present, and future.

    abstract::The habenular neural circuit is attracting increasing attention from researchers in fields as diverse as neuroscience, medicine, behavior, development, and evolution. Recent studies have revealed that this part of the limbic system in the dorsal diencephalon is involved in reward, addiction, and other behaviors and it...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2012.00051

    authors: Beretta CA,Dross N,Guiterrez-Triana JA,Ryu S,Carl M

    更新日期:2012-04-23 00:00:00