On-Chip Training Spiking Neural Networks Using Approximated Backpropagation With Analog Synaptic Devices.

Abstract:

:Hardware-based spiking neural networks (SNNs) inspired by a biological nervous system are regarded as an innovative computing system with very low power consumption and massively parallel operation. To train SNNs with supervision, we propose an efficient on-chip training scheme approximating backpropagation algorithm suitable for hardware implementation. We show that the accuracy of the proposed scheme for SNNs is close to that of conventional artificial neural networks (ANNs) by using the stochastic characteristics of neurons. In a hardware configuration, gated Schottky diodes (GSDs) are used as synaptic devices, which have a saturated current with respect to the input voltage. We design the SNN system by using the proposed on-chip training scheme with the GSDs, which can update their conductance in parallel to speed up the overall system. The performance of the on-chip training SNN system is validated through MNIST data set classification based on network size and total time step. The SNN systems achieve accuracy of 97.83% with 1 hidden layer and 98.44% with 4 hidden layers in fully connected neural networks. We then evaluate the effect of non-linearity and asymmetry of conductance response for long-term potentiation (LTP) and long-term depression (LTD) on the performance of the on-chip training SNN system. In addition, the impact of device variations on the performance of the on-chip training SNN system is evaluated.

journal_name

Front Neurosci

authors

Kwon D,Lim S,Bae JH,Lee ST,Kim H,Seo YT,Oh S,Kim J,Yeom K,Park BG,Lee JH

doi

10.3389/fnins.2020.00423

subject

Has Abstract

pub_date

2020-07-07 00:00:00

pages

423

eissn

1662-4548

issn

1662-453X

journal_volume

14

pub_type

杂志文章
  • Involvement of Secretin in the Control of Cell Survival and Synaptic Plasticity in the Central Nervous System.

    abstract::With emerging evidence showing a wide distribution of secretin (SCT) and its receptor (SCTR) in the central nervous system (CNS), the putative neuropeptide role of SCT has become more appreciated since the disruption of SCT/SCTR axis affects various neural functions. This mini review thus focuses on the effects of SCT...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2020.00387

    authors: Wang L,Zhang L

    更新日期:2020-05-06 00:00:00

  • Spinal Mobilization Prevents NGF-Induced Trunk Mechanical Hyperalgesia and Attenuates Expression of CGRP.

    abstract:Introduction:Low back pain (LBP) is a complex and growing global health problem in need of more effective pain management strategies. Spinal mobilization (SM) is a non-pharmacological approach recommended by most clinical guidelines for LBP, but greater utilization and treatment optimization are hampered by a lack of m...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00385

    authors: Reed WR,Little JW,Lima CR,Sorge RE,Yarar-Fisher C,Eraslan M,Hurt CP,Ness TJ,Gu JG,Martins DF,Li P

    更新日期:2020-04-30 00:00:00

  • MicroRNAs Engage in Complex Circuits Regulating Adult Neurogenesis.

    abstract::The finding that the adult mammalian brain is still capable of producing neurons has ignited a new field of research aiming to identify the molecular mechanisms regulating adult neurogenesis. An improved understanding of these mechanisms could lead to the development of novel approaches to delay cognitive decline and ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2018.00707

    authors: Stappert L,Klaus F,Brüstle O

    更新日期:2018-11-05 00:00:00

  • Evaluation of a P300-Based Brain-Machine Interface for a Robotic Hand-Orthosis Control.

    abstract::This work presents the design, implementation, and evaluation of a P300-based brain-machine interface (BMI) developed to control a robotic hand-orthosis. The purpose of this system is to assist patients with amyotrophic lateral sclerosis (ALS) who cannot open and close their hands by themselves. The user of this inter...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.589659

    authors: Delijorge J,Mendoza-Montoya O,Gordillo JL,Caraza R,Martinez HR,Antelis JM

    更新日期:2020-11-27 00:00:00

  • 50 years of hormonal contraception-time to find out, what it does to our brain.

    abstract::Hormonal contraceptives are on the market for more than 50 years and used by 100 million women worldwide. However, while endogenous steroids have been convincingly associated with change in brain structure, function and cognitive performance, the effects of synthetic steroids contained in hormonal contraceptives on br...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2014.00256

    authors: Pletzer BA,Kerschbaum HH

    更新日期:2014-08-21 00:00:00

  • Non-linear Analysis of Scalp EEG by Using Bispectra: The Effect of the Reference Choice.

    abstract::Bispectral analysis is a signal processing technique that makes it possible to capture the non-linear and non-Gaussian properties of the EEG signals. It has found various applications in EEG research and clinical practice, including the assessment of anesthetic depth, the identification of epileptic seizures, and more...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00262

    authors: Chella F,D'Andrea A,Basti A,Pizzella V,Marzetti L

    更新日期:2017-05-16 00:00:00

  • Spatio-Temporal Dynamics of Intrinsic Networks in Functional Magnetic Imaging Data Using Recurrent Neural Networks.

    abstract::We introduce a novel recurrent neural network (RNN) approach to account for temporal dynamics and dependencies in brain networks observed via functional magnetic resonance imaging (fMRI). Our approach directly parameterizes temporal dynamics through recurrent connections, which can be used to formulate blind source se...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00600

    authors: Hjelm RD,Damaraju E,Cho K,Laufs H,Plis SM,Calhoun VD

    更新日期:2018-09-20 00:00:00

  • Multi-time resolution analysis of speech: evidence from psychophysics.

    abstract::How speech signals are analyzed and represented remains a foundational challenge both for cognitive science and neuroscience. A growing body of research, employing various behavioral and neurobiological experimental techniques, now points to the perceptual relevance of both phoneme-sized (10-40 Hz modulation frequency...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2015.00214

    authors: Chait M,Greenberg S,Arai T,Simon JZ,Poeppel D

    更新日期:2015-06-16 00:00:00

  • Targeted Re-Sequencing Approach of Candidate Genes Implicates Rare Potentially Functional Variants in Tourette Syndrome Etiology.

    abstract::Although the genetic basis of Tourette Syndrome (TS) remains unclear, several candidate genes have been implicated. Using a set of 382 TS individuals of European ancestry we investigated four candidate genes for TS (HDC, SLITRK1, BTBD9, and SLC6A4) in an effort to identify possibly causal variants using a targeted re-...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2016.00428

    authors: Alexander J,Potamianou H,Xing J,Deng L,Karagiannidis I,Tsetsos F,Drineas P,Tarnok Z,Rizzo R,Wolanczyk T,Farkas L,Nagy P,Szymanska U,Androutsos C,Tsironi V,Koumoula A,Barta C,TSGeneSEE.,Sandor P,Barr CL,Tischfield

    更新日期:2016-09-21 00:00:00

  • Speech Discrimination Tasks: A Sensitive Sensory and Cognitive Measure in Early and Mild Multiple Sclerosis.

    abstract::There is a need for reliable and objective measures of early and mild symptomology in multiple sclerosis (MS), as deficits can be subtle and difficult to quantify objectively in patients without overt physical deficits. We hypothesized that a speech-in-noise (SiN) task would be sensitive to demyelinating effects on pr...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.604991

    authors: Iva P,Fielding J,Clough M,White O,Godic B,Martin R,Rajan R

    更新日期:2020-12-23 00:00:00

  • Isoflurane Post-conditioning Ameliorates Cerebral Ischemia/Reperfusion Injury by Enhancing Angiogenesis Through Activating the Shh/Gli Signaling Pathway in Rats.

    abstract::Background: Stroke is the second leading cause of death worldwide. Angiogenesis facilitates the formation of microvascular networks and promotes recovery after stroke. The Shh/Gli signaling pathway is implicated in angiogenesis and cerebral ischemia-reperfusion (I/R) injury. This study aimed at investigating the influ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00321

    authors: Peng L,Yin J,Ge M,Wang S,Xie L,Li Y,Si JQ,Ma K

    更新日期:2019-04-09 00:00:00

  • ATP as a multi-target danger signal in the brain.

    abstract::ATP is released in an activity-dependent manner from different cell types in the brain, fulfilling different roles as a neurotransmitter, neuromodulator, in astrocyte-to-neuron communication, propagating astrocytic responses and formatting microglia responses. This involves the activation of different ATP P2 receptors...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2015.00148

    authors: Rodrigues RJ,Tomé AR,Cunha RA

    更新日期:2015-04-28 00:00:00

  • Specific Patterns of White Matter Alterations Help Distinguishing Alzheimer's and Vascular Dementia.

    abstract::Alzheimer disease (AD) and vascular dementia (VaD) together represent the majority of dementia cases. Since their neuropsychological profiles often overlap and white matter lesions are observed in elderly subjects including AD, differentiating between VaD and AD can be difficult. Characterization of these different fo...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00274

    authors: Palesi F,De Rinaldis A,Vitali P,Castellazzi G,Casiraghi L,Germani G,Bernini S,Anzalone N,Ramusino MC,Denaro FM,Sinforiani E,Costa A,Magenes G,D'Angelo E,Gandini Wheeler-Kingshott CAM,Micieli G

    更新日期:2018-04-25 00:00:00

  • Neuromodulation of the Pineal Gland via Electrical Stimulation of Its Sympathetic Innervation Pathway.

    abstract::Stimulation of the pineal gland via its sympathetic innervation pathway results in the production of N-acetylserotonin and melatonin. Melatonin has many therapeutic roles and is heavily implicated in the regulation of the sleep-wake cycle. In addition, N-acetylserotonin has recently been reported to promote neurogenes...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2020.00264

    authors: Lumsden SC,Clarkson AN,Cakmak YO

    更新日期:2020-04-02 00:00:00

  • An On-chip Spiking Neural Network for Estimation of the Head Pose of the iCub Robot.

    abstract::In this work, we present a neuromorphic architecture for head pose estimation and scene representation for the humanoid iCub robot. The spiking neuronal network is fully realized in Intel's neuromorphic research chip, Loihi, and precisely integrates the issued motor commands to estimate the iCub's head pose in a neuro...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00551

    authors: Kreiser R,Renner A,Leite VRC,Serhan B,Bartolozzi C,Glover A,Sandamirskaya Y

    更新日期:2020-06-23 00:00:00

  • Anatomical pathways for auditory memory II: information from rostral superior temporal gyrus to dorsolateral temporal pole and medial temporal cortex.

    abstract::Auditory recognition memory in non-human primates differs from recognition memory in other sensory systems. Monkeys learn the rule for visual and tactile delayed matching-to-sample within a few sessions, and then show one-trial recognition memory lasting 10-20 min. In contrast, monkeys require hundreds of sessions to ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2015.00158

    authors: Muñoz-López M,Insausti R,Mohedano-Moriano A,Mishkin M,Saunders RC

    更新日期:2015-05-18 00:00:00

  • Membrane Active Antimicrobial Peptides: Translating Mechanistic Insights to Design.

    abstract::Antimicrobial peptides (AMPs) are promising next generation antibiotics that hold great potential for combating bacterial resistance. AMPs can be both bacteriostatic and bactericidal, induce rapid killing and display a lower propensity to develop resistance than do conventional antibiotics. Despite significant progres...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2017.00073

    authors: Li J,Koh JJ,Liu S,Lakshminarayanan R,Verma CS,Beuerman RW

    更新日期:2017-02-14 00:00:00

  • Both Hypo-Connectivity and Hyper-Connectivity of the Insular Subregions Associated With Severity in Children With Autism Spectrum Disorders.

    abstract::Some studies identified hypo-connectivity, while others showed hyper-connectivity of the insula in the autism spectrum disorders (ASD). These contradictory findings leave open the question of whether and to what extent functional connectivity of the insula is altered and how functional connectivity of the insula is as...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00234

    authors: Xu J,Wang H,Zhang L,Xu Z,Li T,Zhou Z,Zhou Z,Gan Y,Hu Q

    更新日期:2018-04-11 00:00:00

  • Secretory function in subplate neurons during cortical development.

    abstract::Subplate cells are among the first generated neurons in the mammalian cerebral cortex and have been implicated in the establishment of cortical wiring. In rodents some subplate neurons persist into adulthood. Here we would like to highlight several converging findings which suggest a novel secretory function of subpla...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2015.00100

    authors: Kondo S,Al-Hasani H,Hoerder-Suabedissen A,Wang WZ,Molnár Z

    更新日期:2015-03-26 00:00:00

  • Quantitative analysis of axonal fiber activation evoked by deep brain stimulation via activation density heat maps.

    abstract:BACKGROUND:Cortical modulation is likely to be involved in the various therapeutic effects of deep brain stimulation (DBS). However, it is currently difficult to predict the changes of cortical modulation during clinical adjustment of DBS. Therefore, we present a novel quantitative approach to estimate anatomical regio...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2015.00028

    authors: Hartmann CJ,Chaturvedi A,Lujan JL

    更新日期:2015-02-10 00:00:00

  • Left Shifting of Language Related Activity Induced by Bihemispheric tDCS in Postacute Aphasia Following Stroke.

    abstract::Both anodal transcranial direct current stimulation (tDCS) of the left IFG and cathodal stimulation of the right IFG were shown to improve rehabilitation of stroke patients with Broca's aphasia. The study aimed at assessing the impact of a bihemispheric IFG stimulation compared to sham on postacute non-fluent aphasia....

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00295

    authors: Feil S,Eisenhut P,Strakeljahn F,Müller S,Nauer C,Bansi J,Weber S,Liebs A,Lefaucheur JP,Kesselring J,Gonzenbach R,Mylius V

    更新日期:2019-04-26 00:00:00

  • The Impact of Single Session Intermittent Theta-Burst Stimulation over the Dorsolateral Prefrontal Cortex and Posterior Superior Temporal Sulcus on Adults with Autism Spectrum Disorder.

    abstract::Intermittent theta burst stimulation (iTBS), a patterned repetitive transcranial magnetic stimulation, was applied over the posterior superior temporal sulcus (pSTS) or dorsolateral prefrontal cortex (DLPFC) to explore its impact in adults with autism spectrum disorder (ASD). Among 25 adults with ASD, 19 (mean age: 20...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00255

    authors: Ni HC,Hung J,Wu CT,Wu YY,Chang CJ,Chen RS,Huang YZ

    更新日期:2017-05-09 00:00:00

  • Virtual Balancing for Studying and Training Postural Control.

    abstract::Postural control during free stance has been frequently interpreted in terms of balancing an inverted pendulum. This even holds, if subjects do not balance their own, but an external body weight. We introduce here a virtual balancing apparatus, which produces torque in the ankle joint as a function of ankle angle rese...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00531

    authors: Buettner D,Dalin D,Wiesmeier IK,Maurer C

    更新日期:2017-09-26 00:00:00

  • Computational detection of alternative exon usage.

    abstract:BACKGROUND:With the advent of the GeneChip Exon Arrays, it is now possible to extract "exon-level" expression estimates, allowing for detection of alternative splicing events, one of the primary mechanisms of transcript diversity. In the context of (1) a complex trait use case and (2) a human cerebellum vs. heart compa...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2011.00069

    authors: Laderas TG,Walter NA,Mooney M,Vartanian K,Darakjian P,Buck K,Harrington CA,Belknap J,Hitzemann R,McWeeney SK

    更新日期:2011-05-13 00:00:00

  • Anodal Transcranial Direct Current Stimulation Increases Bilateral Directed Brain Connectivity during Motor-Imagery Based Brain-Computer Interface Control.

    abstract::Transcranial direct current stimulation (tDCS) has been shown to affect motor and cognitive task performance and learning when applied to brain areas involved in the task. Targeted stimulation has also been found to alter connectivity within the stimulated hemisphere during rest. However, the connectivity effect of th...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00691

    authors: Baxter BS,Edelman BJ,Sohrabpour A,He B

    更新日期:2017-12-07 00:00:00

  • Motorized Shoes Induce Robust Sensorimotor Adaptation in Walking.

    abstract::The motor system has the flexibility to update motor plans according to systematic changes in the environment or the body. This capacity is studied in the laboratory through sensorimotor adaptation paradigms imposing sustained and predictable motor demands specific to the task at hand. However, these studies are tied ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00174

    authors: Aucie Y,Zhang X,Sargent R,Torres-Oviedo G

    更新日期:2020-03-06 00:00:00

  • Cortical iron regulation and inflammatory response in Alzheimer's disease and APPSWE/PS1ΔE9 mice: a histological perspective.

    abstract::Disruption of iron homeostasis and increased glial response are known to occur in brains afflicted by Alzheimer's disease (AD). While the APP/PS1 transgenic mouse model recapitulates the hallmark amyloid-beta plaque pathology of AD, it does so in a different neuronal mileu than humans. Understanding the iron character...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2015.00255

    authors: Meadowcroft MD,Connor JR,Yang QX

    更新日期:2015-07-23 00:00:00

  • Synthesis of neural networks for spatio-temporal spike pattern recognition and processing.

    abstract::The advent of large scale neural computational platforms has highlighted the lack of algorithms for synthesis of neural structures to perform predefined cognitive tasks. The Neural Engineering Framework (NEF) offers one such synthesis, but it is most effective for a spike rate representation of neural information, and...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2013.00153

    authors: Tapson JC,Cohen GK,Afshar S,Stiefel KM,Buskila Y,Wang RM,Hamilton TJ,van Schaik A

    更新日期:2013-08-30 00:00:00

  • Evaluating auditory stream segregation of SAM tone sequences by subjective and objective psychoacoustical tasks, and brain activity.

    abstract::Auditory stream segregation refers to a segregated percept of signal streams with different acoustic features. Different approaches have been pursued in studies of stream segregation. In psychoacoustics, stream segregation has mostly been investigated with a subjective task asking the subjects to report their percept....

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2014.00119

    authors: Dolležal LV,Brechmann A,Klump GM,Deike S

    更新日期:2014-06-06 00:00:00

  • Induction of NTPDase1/CD39 by Reactive Microglia and Macrophages Is Associated With the Functional State During EAE.

    abstract::Purinergic signaling is critically involved in neuroinflammation associated with multiple sclerosis (MS) and its major inflammatory animal model, experimental autoimmune encephalomyelitis (EAE). Herein, we explored the expression of ectonucleoside triphosphate diphosphohydrolase1 (NTPDase1/CD39) in the spinal cord, at...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00410

    authors: Jakovljevic M,Lavrnja I,Bozic I,Milosevic A,Bjelobaba I,Savic D,Sévigny J,Pekovic S,Nedeljkovic N,Laketa D

    更新日期:2019-04-26 00:00:00