Synaptic Plasticity Dynamics for Deep Continuous Local Learning (DECOLLE).

Abstract:

:A growing body of work underlines striking similarities between biological neural networks and recurrent, binary neural networks. A relatively smaller body of work, however, addresses the similarities between learning dynamics employed in deep artificial neural networks and synaptic plasticity in spiking neural networks. The challenge preventing this is largely caused by the discrepancy between the dynamical properties of synaptic plasticity and the requirements for gradient backpropagation. Learning algorithms that approximate gradient backpropagation using local error functions can overcome this challenge. Here, we introduce Deep Continuous Local Learning (DECOLLE), a spiking neural network equipped with local error functions for online learning with no memory overhead for computing gradients. DECOLLE is capable of learning deep spatio temporal representations from spikes relying solely on local information, making it compatible with neurobiology and neuromorphic hardware. Synaptic plasticity rules are derived systematically from user-defined cost functions and neural dynamics by leveraging existing autodifferentiation methods of machine learning frameworks. We benchmark our approach on the event-based neuromorphic dataset N-MNIST and DvsGesture, on which DECOLLE performs comparably to the state-of-the-art. DECOLLE networks provide continuously learning machines that are relevant to biology and supportive of event-based, low-power computer vision architectures matching the accuracies of conventional computers on tasks where temporal precision and speed are essential.

journal_name

Front Neurosci

authors

Kaiser J,Mostafa H,Neftci E

doi

10.3389/fnins.2020.00424

subject

Has Abstract

pub_date

2020-05-12 00:00:00

pages

424

eissn

1662-4548

issn

1662-453X

journal_volume

14

pub_type

杂志文章
  • Evolutionary Musicology Meets Embodied Cognition: Biocultural Coevolution and the Enactive Origins of Human Musicality.

    abstract::Despite evolutionary musicology's interdisciplinary nature, and the diverse methods it employs, the field has nevertheless tended to divide into two main positions. Some argue that music should be understood as a naturally selected adaptation, while others claim that music is a product of culture with little or no rel...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2017.00519

    authors: van der Schyff D,Schiavio A

    更新日期:2017-09-29 00:00:00

  • Low-Dimensional Motor Cortex Dynamics Preserve Kinematics Information During Unconstrained Locomotion in Nonhuman Primates.

    abstract::The dynamical systems view of movement generation in motor cortical areas has emerged as an effective way to explain the firing properties of populations of neurons recorded from these regions. Recently, many studies have focused on finding low-dimensional representations of these dynamical systems during voluntary re...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.01046

    authors: Xing D,Aghagolzadeh M,Truccolo W,Borton D

    更新日期:2019-10-04 00:00:00

  • Effects of the Openness to Experience Polygenic Score on Cortical Thickness and Functional Connectivity.

    abstract::Openness to experience (OTE) has relatively stable and heritable characteristics. Previous studies have used candidate gene approaches to explore the genetic mechanisms of OTE, but genome-wide polygenic scores have a greater genetic effect than other genetic analysis methods, and previous studies have never examined t...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.607912

    authors: Ren Z,Liu C,Meng J,Liu Q,Shi L,Wu X,Song L,Qiu J

    更新日期:2021-01-11 00:00:00

  • No Effects of Non-invasive Brain Stimulation on Multiple Sessions of Object-Location-Memory Training in Healthy Older Adults.

    abstract::Object-location memory (OLM) is known to decline with normal aging, a process accelerated in pathological conditions like mild cognitive impairment (MCI). In order to maintain cognitive health and to delay the transition from healthy to pathological conditions, novel strategies are being explored. Tentative evidence s...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00746

    authors: Külzow N,Cavalcanti de Sousa AV,Cesarz M,Hanke JM,Günsberg A,Harder S,Koblitz S,Grittner U,Flöel A

    更新日期:2018-01-10 00:00:00

  • Evaluating the Influence of Spatial Resampling for Motion Correction in Resting-State Functional MRI.

    abstract::Head motion is one of major concerns in current resting-state functional MRI studies. Image realignment including motion estimation and spatial resampling is often applied to achieve rigid-body motion correction. While the accurate estimation of motion parameters has been addressed in most studies, spatial resampling ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2016.00591

    authors: Yuan L,He H,Zhang H,Zhong J

    更新日期:2016-12-27 00:00:00

  • Chatting with the neighbors: crosstalk between Rho-kinase (ROCK) and other signaling pathways for treatment of neurological disorders.

    abstract::ROCK inhibition has been largely applied as a strategy to treat neurodegenerative diseases (NDDs) and promising results have been obtained in the recent years. However, the underlying molecular and cellular mechanisms are not fully understood and different models have been proposed for neurodegenerative disorders. Her...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2015.00198

    authors: Hensel N,Rademacher S,Claus P

    更新日期:2015-06-02 00:00:00

  • Acupuncture Improves Comorbid Cognitive Impairments Induced by Neuropathic Pain in Mice.

    abstract::Growing evidence indicates that neuropathic pain is frequently accompanied by cognitive impairments, which aggravate the quality of life of chronic pain patients. Here, we investigated whether acupuncture treatments can improve cognitive dysfunction as well as allodynia induced by neuropathic pain in mice. One week af...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00995

    authors: Jang JH,Kim YK,Jung WM,Kim HK,Song EM,Kim HY,Oh JY,Park JY,Ryu Y,Song MY,Park HJ

    更新日期:2019-09-20 00:00:00

  • The behavioral relevance of multisensory neural response interactions.

    abstract::Sensory information can interact to impact perception and behavior. Foods are appreciated according to their appearance, smell, taste and texture. Athletes and dancers combine visual, auditory, and somatosensory information to coordinate their movements. Under laboratory settings, detection and discrimination are like...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/neuro.01.009.2010

    authors: Sperdin HF,Cappe C,Murray MM

    更新日期:2010-05-15 00:00:00

  • Preferred Tempo and Low-Audio-Frequency Bias Emerge From Simulated Sub-cortical Processing of Sounds With a Musical Beat.

    abstract::Prior research has shown that musical beats are salient at the level of the cortex in humans. Yet below the cortex there is considerable sub-cortical processing that could influence beat perception. Some biases, such as a tempo preference and an audio frequency bias for beat timing, could result from sub-cortical proc...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00349

    authors: Zuk NJ,Carney LH,Lalor EC

    更新日期:2018-05-29 00:00:00

  • A Framework for Adapting Deep Brain Stimulation Using Parkinsonian State Estimates.

    abstract::The mechanisms underlying the beneficial effects of deep brain stimulation (DBS) for Parkinson's disease (PD) remain poorly understood and are still under debate. This has hindered the development of adaptive DBS (aDBS). For further progress in aDBS, more insight into the dynamics of PD is needed, which can be obtaine...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00499

    authors: Mohammed A,Bayford R,Demosthenous A

    更新日期:2020-05-19 00:00:00

  • Disruption of Intracellular ATP Generation and Tight Junction Protein Expression during the Course of Brain Edema Induced by Subacute Poisoning of 1,2-Dichloroethane.

    abstract::The aim of this study was to explore changes in intracellular ATP generation and tight junction protein expression during the course of brain edema induced by subacute poisoning of 1,2-dichloroethane (1,2-DCE). Mice were exposed to 1.2 g/m3 1,2-DCE for 3.5 h per day for 1, 2, or 3 days, namely group A, B, and C. Na+-K...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00012

    authors: Wang G,Yuan Y,Gao L,Tan X,Yang G,Zhao F,Jin Y

    更新日期:2018-01-23 00:00:00

  • The Energy Metabolism Dysfunction in Psychiatric Disorders Postmortem Brains: Focus on Proteomic Evidence.

    abstract::Psychiatric disorders represent a great medical and social challenge and people suffering from these conditions face many impairments regarding personal and professional life. In addition, a mental disorder will manifest itself in approximately one quarter of the world's population at some period of their life. Dysfun...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2017.00493

    authors: Zuccoli GS,Saia-Cereda VM,Nascimento JM,Martins-de-Souza D

    更新日期:2017-09-07 00:00:00

  • Whole brain functional connectivity using phase locking measures of resting state magnetoencephalography.

    abstract::The analysis of spontaneous functional connectivity (sFC) reveals the statistical connections between regions of the brain consistent with underlying functional communication networks within the brain. In this work, we describe the implementation of a complete all-to-all network analysis of resting state neuronal acti...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2014.00141

    authors: Schmidt BT,Ghuman AS,Huppert TJ

    更新日期:2014-06-11 00:00:00

  • Progesterone mediates brain functional connectivity changes during the menstrual cycle-a pilot resting state MRI study.

    abstract::The growing interest in intrinsic brain organization has sparked various innovative approaches to generating comprehensive connectivity-based maps of the human brain. Prior reports point to a sexual dimorphism of the structural and functional human connectome. However, it is uncertain whether subtle changes in sex hor...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2015.00044

    authors: Arélin K,Mueller K,Barth C,Rekkas PV,Kratzsch J,Burmann I,Villringer A,Sacher J

    更新日期:2015-02-23 00:00:00

  • Impact of Resveratrol on Glucose Control, Hippocampal Structure and Connectivity, and Memory Performance in Patients with Mild Cognitive Impairment.

    abstract::In healthy older adults, resveratrol supplementation has been shown to improve long-term glucose control, resting-state functional connectivity (RSFC) of the hippocampus, and memory function. Here, we aimed to investigate if these beneficial effects extend to individuals at high-risk for dementia, i.e., patients with ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00105

    authors: Köbe T,Witte AV,Schnelle A,Tesky VA,Pantel J,Schuchardt JP,Hahn A,Bohlken J,Grittner U,Flöel A

    更新日期:2017-03-07 00:00:00

  • Opioid Deaths: Trends, Biomarkers, and Potential Drug Interactions Revealed by Decision Tree Analyses.

    abstract::Opioid abuse is now the primary cause of accidental deaths in the United States. Studies over several decades established the cyclical nature of abused drugs of choice, with a current resurgence of heroin abuse and, more recently, fentanyl's emergence as a major precipitant of drug-related deaths. To better understand...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00728

    authors: Saad MH,Savonen CL,Rumschlag M,Todi SV,Schmidt CJ,Bannon MJ

    更新日期:2018-10-23 00:00:00

  • Targeting glutamate uptake to treat alcohol use disorders.

    abstract::Alcoholism is a serious public health concern that is characterized by the development of tolerance to alcohol's effects, increased consumption, loss of control over drinking and the development of physical dependence. This cycle is often times punctuated by periods of abstinence, craving and relapse. The development ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2015.00144

    authors: Rao PS,Bell RL,Engleman EA,Sari Y

    更新日期:2015-04-23 00:00:00

  • Altered Large-Scale Brain Functional Connectivity in Ocular Hypertension.

    abstract::We hypothesized that assessment of brain connectivity may shed light on the underpinnings of ocular hypertension (OHT), characterized by raised intraocular pressure (IOP) and no typical glaucomatous findings. OHT carries a risk for future glaucoma development, thus representing a model of presymptomatic condition. In ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00146

    authors: Giorgio A,Zhang J,Costantino F,De Stefano N,Frezzotti P

    更新日期:2020-03-05 00:00:00

  • Low Cost Interconnected Architecture for the Hardware Spiking Neural Networks.

    abstract::A novel low cost interconnected architecture (LCIA) is proposed in this paper, which is an efficient solution for the neuron interconnections for the hardware spiking neural networks (SNNs). It is based on an all-to-all connection that takes each paired input and output nodes of multi-layer SNNs as the source and dest...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00857

    authors: Luo Y,Wan L,Liu J,Harkin J,McDaid L,Cao Y,Ding X

    更新日期:2018-11-21 00:00:00

  • Effects of Non-invasive Brain Stimulation on Stimulant Craving in Users of Cocaine, Amphetamine, or Methamphetamine: A Systematic Review and Meta-Analysis.

    abstract::Dopamine system plays a pivotal role in specific kinds of substance use disorders (SUD, i. e., cocaine and methamphetamine use disorders). Many studies addressed whether dopamine-involved craving could be alleviated by non-invasive brain stimulation (NIBS) techniques. Nevertheless, the outcomes were highly inconsisten...

    journal_title:Frontiers in neuroscience

    pub_type:

    doi:10.3389/fnins.2019.01095

    authors: Ma T,Sun Y,Ku Y

    更新日期:2019-10-18 00:00:00

  • Tau protein and adult hippocampal neurogenesis.

    abstract::Tau protein is a microtubule-associated protein found in the axonal compartment that stabilizes neuronal microtubules under normal physiological conditions. Tau metabolism has attracted much attention because of its role in neurodegenerative disorders called tauopathies, mainly Alzheimer disease. Here, we review recen...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2012.00104

    authors: Fuster-Matanzo A,Llorens-Martín M,Jurado-Arjona J,Avila J,Hernández F

    更新日期:2012-07-09 00:00:00

  • Effects of Field-Map Distortion Correction on Resting State Functional Connectivity MRI.

    abstract::Magnetic field inhomogeneities cause geometric distortions of echo planar images used for functional magnetic resonance imaging (fMRI). To reduce this problem, distortion correction (DC) with field map is widely used for both task and resting-state fMRI (rs-fMRI). Although DC with field map has been reported to improv...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00656

    authors: Togo H,Rokicki J,Yoshinaga K,Hisatsune T,Matsuda H,Haga N,Hanakawa T

    更新日期:2017-12-01 00:00:00

  • Development of Performance and ERPs in a Flanker Task in Children and Adolescents with Tourette Syndrome-A Follow-Up Study.

    abstract::Background: Tourette Syndrome (TS) is a neurodevelopmental disorder with childhood-onset, with a typical decline in tic severity, as well as an increasing ability to suppress tics in late childhood and adolescence. These processes develop in parallel with general improvement of self-regulatory abilities, and performan...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00305

    authors: Eichele H,Eichele T,Marquardt L,Adolfsdottir S,Hugdahl K,Sørensen L,Plessen KJ

    更新日期:2017-06-12 00:00:00

  • A simple method to reconstruct firing rates from dendritic calcium signals.

    abstract::Calcium imaging using fluorescent reporters is the most widely used optical approach to investigate activity in intact neuronal circuits with single-cell resolution. Calcium signals, however, are often difficult to interpret, especially if the desired output quantity is membrane voltage or instantaneous firing rates. ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/neuro.01.032.2008

    authors: Moreaux L,Laurent G

    更新日期:2008-12-15 00:00:00

  • Coding of reward probability and risk by single neurons in animals.

    abstract::Probability and risk are important factors for value-based decision making and optimal foraging. In order to survive in an unpredictable world, organisms must be able to assess the probability and risk attached to future events and use this information to generate adaptive behavior. Recent studies in non-human primate...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2011.00121

    authors: Burke CJ,Tobler PN

    更新日期:2011-10-11 00:00:00

  • Pyff - a pythonic framework for feedback applications and stimulus presentation in neuroscience.

    abstract::This paper introduces Pyff, the Pythonic feedback framework for feedback applications and stimulus presentation. Pyff provides a platform-independent framework that allows users to develop and run neuroscientific experiments in the programming language Python. Existing solutions have mostly been implemented in C++, wh...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2010.00179

    authors: Venthur B,Scholler S,Williamson J,Dähne S,Treder MS,Kramarek MT,Müller KR,Blankertz B

    更新日期:2010-12-02 00:00:00

  • Noxious Iron-Calcium Connections in Neurodegeneration.

    abstract::Iron and calcium share the common feature of being essential for normal neuronal function. Iron is required for mitochondrial function, synaptic plasticity, and the development of cognitive functions whereas cellular calcium signals mediate neurotransmitter exocytosis, axonal growth and synaptic plasticity, and contro...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2019.00048

    authors: Núñez MT,Hidalgo C

    更新日期:2019-02-12 00:00:00

  • On-Chip Training Spiking Neural Networks Using Approximated Backpropagation With Analog Synaptic Devices.

    abstract::Hardware-based spiking neural networks (SNNs) inspired by a biological nervous system are regarded as an innovative computing system with very low power consumption and massively parallel operation. To train SNNs with supervision, we propose an efficient on-chip training scheme approximating backpropagation algorithm ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00423

    authors: Kwon D,Lim S,Bae JH,Lee ST,Kim H,Seo YT,Oh S,Kim J,Yeom K,Park BG,Lee JH

    更新日期:2020-07-07 00:00:00

  • Short-Term Sensorimotor Deprivation Impacts Feedforward and Feedback Processes of Motor Control.

    abstract::Sensory loss involves irreversible behavioral and neural changes. Paradigms of short-term limb immobilization mimic deprivation of proprioceptive inputs and motor commands, which occur after the loss of limb use. While several studies have shown that short-term immobilization induced motor control impairments, the ori...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00696

    authors: Scotto CR,Meugnot A,Casiez G,Toussaint L

    更新日期:2020-07-01 00:00:00

  • Consequences of serotonin transporter genotype and early adversity on behavioral profile - pathology or adaptation?

    abstract::This review focuses on how behavioral profile is shaped by early adversity in individuals with varying serotonin transporter (5-HTT) genotype. In a recent study on 5-HTT knockout mice Heiming et al. (2009) simulated a 'dangerous environment' by confronting pregnant and lactating females with odor cues of unfamiliar ma...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2010.00187

    authors: Heiming RS,Sachser N

    更新日期:2010-12-08 00:00:00