RAPA-ConvNets: Modified Convolutional Networks for Accelerated Training on Architectures With Analog Arrays.

Abstract:

:Analog arrays are a promising emerging hardware technology with the potential to drastically speed up deep learning. Their main advantage is that they employ analog circuitry to compute matrix-vector products in constant time, irrespective of the size of the matrix. However, ConvNets map very unfavorably onto analog arrays when done in a straight-forward manner, because kernel matrices are typically small and the constant time operation needs to be sequentially iterated a large number of times. Here, we propose to parallelize the training by replicating the kernel matrix of a convolution layer on distinct analog arrays, and randomly divide parts of the compute among them. With this modification, analog arrays execute ConvNets with a large acceleration factor that is proportional to the number of kernel matrices used per layer (here tested 16-1024). Despite having more free parameters, we show analytically and in numerical experiments that this new convolution architecture is self-regularizing and implicitly learns similar filters across arrays. We also report superior performance on a number of datasets and increased robustness to adversarial attacks. Our investigation suggests to revise the notion that emerging hardware architectures that feature analog arrays for fast matrix-vector multiplication are not suitable for ConvNets.

journal_name

Front Neurosci

authors

Rasch MJ,Gokmen T,Rigotti M,Haensch W

doi

10.3389/fnins.2019.00753

subject

Has Abstract

pub_date

2019-07-30 00:00:00

pages

753

eissn

1662-4548

issn

1662-453X

journal_volume

13

pub_type

杂志文章
  • All in the Family: How the APPs Regulate Neurogenesis.

    abstract::Recent intriguing evidence suggests that metabolites of amyloid precursor protein (APP), mutated in familial forms of Alzheimer's disease (AD), play critical roles in developmental and postnatal neurogenesis. Of note is soluble APPα (sAPPα) that regulates neural progenitor cell proliferation. The APP family encompasse...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2012.00081

    authors: Lazarov O,Demars MP

    更新日期:2012-06-04 00:00:00

  • A Novel Tetramethylpyrazine Derivative Protects Against Glutamate-Induced Cytotoxicity Through PGC1α/Nrf2 and PI3K/Akt Signaling Pathways.

    abstract::Glutamate-induced excitotoxicity is one of the main causes of neuronal cell death in stroke. Compound 22a has been previously reported as a promising neuroprotective compound derived from tetramethylpyrazine, which is a widely used active ingredient of traditional Chinese medicine Chuanxiong (Ligusticum wallichii Fran...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00567

    authors: Chen H,Cao J,Zhu Z,Zhang G,Shan L,Yu P,Wang Y,Sun Y,Zhang Z

    更新日期:2018-08-15 00:00:00

  • Evaluating the Influence of Spatial Resampling for Motion Correction in Resting-State Functional MRI.

    abstract::Head motion is one of major concerns in current resting-state functional MRI studies. Image realignment including motion estimation and spatial resampling is often applied to achieve rigid-body motion correction. While the accurate estimation of motion parameters has been addressed in most studies, spatial resampling ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2016.00591

    authors: Yuan L,He H,Zhang H,Zhong J

    更新日期:2016-12-27 00:00:00

  • Manipulation of the Duration of the Initial Self-Control Task Within the Sequential-Task Paradigm: Effect on Exercise Performance.

    abstract::Self-control exertion on an initial task has been associated with impaired performance on subsequent physical tasks also requiring self-control; an effect suggested to be mediated by changes in perceptions of pain and motivation. However, the effects of spending longer on the initial self-control task are unknown. Thi...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.571312

    authors: Boat R,Hunte R,Welsh E,Dunn A,Treadwell E,Cooper SB

    更新日期:2020-10-08 00:00:00

  • Wt1 Positive dB4 Neurons in the Hindbrain Are Crucial for Respiration.

    abstract::Central pattern generator (CPG) networks coordinate the generation of rhythmic activity such as locomotion and respiration. Their development is driven by various transcription factors, one of which is the Wilms tumor protein (Wt1). It is present in dI6 neurons of the mouse spinal cord, and involved in the coordinatio...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.529487

    authors: Schnerwitzki D,Hayn C,Perner B,Englert C

    更新日期:2020-11-30 00:00:00

  • Prevention of Neurite Spine Loss Induced by Dopamine D2 Receptor Overactivation in Striatal Neurons.

    abstract::Psychosis has been considered a disorder of impaired neuronal connectivity. Evidence for excessive formation of dopamine D2 receptor (D2R) - disrupted in schizophrenia 1 (DISC1) complexes has led to a new perspective on molecular mechanisms involved in psychotic symptoms. Here, we investigated how excessive D2R-DISC1 ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00642

    authors: Zheng P,Su QP,Jin D,Yu Y,Huang XF

    更新日期:2020-06-23 00:00:00

  • Central regulation of metabolism by protein tyrosine phosphatases.

    abstract::Protein tyrosine phosphatases (PTPs) are important regulators of intracellular signaling pathways via the dephosphorylation of phosphotyrosyl residues on various receptor and non-receptor substrates. The phosphorylation state of central nervous system (CNS) signaling components underlies the molecular mechanisms of a ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2012.00192

    authors: Tsou RC,Bence KK

    更新日期:2013-01-07 00:00:00

  • The Profiles of Non-stationarity and Non-linearity in the Time Series of Resting-State Brain Networks.

    abstract::The linearity and stationarity of fMRI time series need to be understood due to their important roles in the choice of approach for brain network analysis. In this paper, we investigated the stationarity and linearity of resting-state fMRI (rs-fMRI) time-series data from the Midnight Scan Club datasets. The degree of ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00493

    authors: Guan S,Jiang R,Bian H,Yuan J,Xu P,Meng C,Biswal B

    更新日期:2020-06-11 00:00:00

  • Neuromodulated Synaptic Plasticity on the SpiNNaker Neuromorphic System.

    abstract::SpiNNaker is a digital neuromorphic architecture, designed specifically for the low power simulation of large-scale spiking neural networks at speeds close to biological real-time. Unlike other neuromorphic systems, SpiNNaker allows users to develop their own neuron and synapse models as well as specify arbitrary conn...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00105

    authors: Mikaitis M,Pineda García G,Knight JC,Furber SB

    更新日期:2018-02-27 00:00:00

  • Cortical iron regulation and inflammatory response in Alzheimer's disease and APPSWE/PS1ΔE9 mice: a histological perspective.

    abstract::Disruption of iron homeostasis and increased glial response are known to occur in brains afflicted by Alzheimer's disease (AD). While the APP/PS1 transgenic mouse model recapitulates the hallmark amyloid-beta plaque pathology of AD, it does so in a different neuronal mileu than humans. Understanding the iron character...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2015.00255

    authors: Meadowcroft MD,Connor JR,Yang QX

    更新日期:2015-07-23 00:00:00

  • Attention-deficit hyperactivity disorder (ADHD) stimulant medications as cognitive enhancers.

    abstract::Recent increases in attention deficit hyperactivity disorder (ADHD) diagnoses, and the escalation of stimulant prescriptions, has raised concern about diversion and abuse of stimulants, as well as the ethics of using these drugs as "cognitive enhancers."Such concern appears misplaced in the face of substantial evidenc...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2013.00082

    authors: Advokat C,Scheithauer M

    更新日期:2013-05-29 00:00:00

  • Early Pain Exposure Influences Functional Brain Connectivity in Very Preterm Neonates.

    abstract:Background:Early exposure to nociceptive events may cause brain structural alterations in preterm neonates, with long-lasting consequences on neurodevelopmental outcome. Little is known on the extent to which early pain may affect brain connectivity. We aim to evaluate brain functional connectivity changes in preterm n...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00899

    authors: Tortora D,Severino M,Di Biase C,Malova M,Parodi A,Minghetti D,Traggiai C,Uccella S,Boeri L,Morana G,Rossi A,Ramenghi LA

    更新日期:2019-08-23 00:00:00

  • Urinary oxytocin positively correlates with performance in facial visual search in unmarried males, without specific reaction to infant face.

    abstract::The neuropeptide oxytocin plays a central role in prosocial and parental behavior in non-human mammals as well as humans. It has been suggested that oxytocin may affect visual processing of infant faces and emotional reaction to infants. Healthy male volunteers (N = 13) were tested for their ability to detect infant o...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2014.00217

    authors: Saito A,Hamada H,Kikusui T,Mogi K,Nagasawa M,Mitsui S,Higuchi T,Hasegawa T,Hiraki K

    更新日期:2014-07-29 00:00:00

  • Dynamic neural fields as a step toward cognitive neuromorphic architectures.

    abstract::Dynamic Field Theory (DFT) is an established framework for modeling embodied cognition. In DFT, elementary cognitive functions such as memory formation, formation of grounded representations, attentional processes, decision making, adaptation, and learning emerge from neuronal dynamics. The basic computational element...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2013.00276

    authors: Sandamirskaya Y

    更新日期:2014-01-22 00:00:00

  • Discerning Neurogenic vs. Non-Neurogenic Postnatal Lateral Ventricular Astrocytes via Activity-Dependent Input.

    abstract::Throughout development, neural stem cells (NSCs) give rise to differentiated neurons, astrocytes, and oligodendrocytes which together modulate perception, memory, and behavior in the adult nervous system. To understand how NSCs contribute to postnatal/adult brain remodeling and repair after injury, the lateral ventric...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2016.00111

    authors: Adlaf EW,Mitchell-Dick A,Kuo CT

    更新日期:2016-03-24 00:00:00

  • Discriminating Fake From True Brain Injury Using Latency of Left Frontal Neural Responses During Old/New Memory Recognition.

    abstract::Traumatic brain injury (TBI) is a major public health concern that affects 69 million individuals each year worldwide. Neuropsychologists report that up to 40% of individuals undergoing evaluations for TBI may be malingering neurocognitive deficits for a compensatory reward. The memory recognition test of malingering ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00988

    authors: Neal J,Strothkamp S,Bedingar E,Cordero P,Wagner B,Vagnini V,Jiang Y

    更新日期:2019-09-25 00:00:00

  • Design of an Adaptive Human-Machine System Based on Dynamical Pattern Recognition of Cognitive Task-Load.

    abstract::This paper developed a cognitive task-load (CTL) classification algorithm and allocation strategy to sustain the optimal operator CTL levels over time in safety-critical human-machine integrated systems. An adaptive human-machine system is designed based on a non-linear dynamic CTL classifier, which maps a set of elec...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00129

    authors: Zhang J,Yin Z,Wang R

    更新日期:2017-03-17 00:00:00

  • Pharmaco-fUS for Characterizing Drugs for Alzheimer's Disease - The Case of THN201, a Drug Combination of Donepezil Plus Mefloquine.

    abstract::Donepezil is a potent acetylcholinesterase inhibitor, largely used worldwide to alleviate cognitive symptoms in Alzheimer's disease (AD). Beyond the widely described neuronal impact of donepezil, it was recently shown that targeting connexins, the proteins involved in astrocyte network organization, potentiates donepe...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00835

    authors: Vidal B,Droguerre M,Valdebenito M,Zimmer L,Hamon M,Mouthon F,Charvériat M

    更新日期:2020-08-12 00:00:00

  • Behavioral Paradigms to Probe Individual Mouse Differences in Value-Based Decision Making.

    abstract::Value-based decision making relies on distributed neural systems that weigh the benefits of actions against the cost required to obtain a given outcome. Perturbations of these systems are thought to underlie abnormalities in action selection seen across many neuropsychiatric disorders. Genetic tools in mice provide a ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00050

    authors: Alabi OO,Fortunato MP,Fuccillo MV

    更新日期:2019-02-07 00:00:00

  • VLSI Implementation of a 2.8 Gevent/s Packet-Based AER Interface with Routing and Event Sorting Functionality.

    abstract::State-of-the-art large-scale neuromorphic systems require sophisticated spike event communication between units of the neural network. We present a high-speed communication infrastructure for a waferscale neuromorphic system, based on application-specific neuromorphic communication ICs in an field programmable gate ar...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2011.00117

    authors: Scholze S,Schiefer S,Partzsch J,Hartmann S,Mayr CG,Höppner S,Eisenreich H,Henker S,Vogginger B,Schüffny R

    更新日期:2011-10-12 00:00:00

  • Whole brain functional connectivity using phase locking measures of resting state magnetoencephalography.

    abstract::The analysis of spontaneous functional connectivity (sFC) reveals the statistical connections between regions of the brain consistent with underlying functional communication networks within the brain. In this work, we describe the implementation of a complete all-to-all network analysis of resting state neuronal acti...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2014.00141

    authors: Schmidt BT,Ghuman AS,Huppert TJ

    更新日期:2014-06-11 00:00:00

  • Enhanced Functional Coupling of Hippocampal Sub-regions in Congenitally and Late Blind Subjects.

    abstract::The hippocampus has exhibited navigation-related changes in volume and activity after visual deprivation; however, the resting-state functional connectivity (rsFC) changes of the hippocampus in the blind remains unknown. In this study, we focused on sub-region-specific rsFC changes of the hippocampus and their associa...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2016.00612

    authors: Ma G,Yang D,Qin W,Liu Y,Jiang T,Yu C

    更新日期:2017-01-10 00:00:00

  • Alpha-Synuclein Continues to Enhance SNARE-Dependent Vesicle Docking at Exorbitant Concentrations.

    abstract::Recently, Parkinson's disease-associated α-synuclein (αS) has emerged as an important regulator for SNARE-dependent vesicle fusion. However, it is controversial if excessive accumulation of αS, even in the absence of aggregation, impairs neurotransmission. Here we use a single vesicle fusion assay with ms time resolut...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00216

    authors: Hawk BJD,Khounlo R,Shin YK

    更新日期:2019-03-21 00:00:00

  • Pumilio Regulates Sleep Homeostasis in Response to Chronic Sleep Deprivation in Drosophila melanogaster.

    abstract::Recent studies have identified the Drosophila brain circuits involved in the sleep/wake switch and have pointed to the modulation of neuronal excitability as one of the underlying mechanisms triggering sleep need. In this study we aimed to explore the link between the homeostatic regulation of neuronal excitability an...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00319

    authors: De Jesús-Olmo LA,Rodríguez N,Francia M,Alemán-Rios J,Pacheco-Agosto CJ,Ortega-Torres J,Nieves R,Fuenzalida-Uribe N,Ghezzi A,Agosto JL

    更新日期:2020-04-17 00:00:00

  • Online tracking of the contents of conscious perception using real-time fMRI.

    abstract::Perception is an active process that interprets and structures the stimulus input based on assumptions about its possible causes. We use real-time functional magnetic resonance imaging (rtfMRI) to investigate a particularly powerful demonstration of dynamic object integration in which the same physical stimulus interm...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2014.00116

    authors: Reichert C,Fendrich R,Bernarding J,Tempelmann C,Hinrichs H,Rieger JW

    更新日期:2014-05-23 00:00:00

  • Obesity as a Risk Factor for Alzheimer's Disease: Implication of Leptin and Glutamate.

    abstract::Obesity is known to induce leptin and insulin resistance. Leptin is a peptide hormone synthesized in adipose tissue that mainly regulates food intake. It has been shown that insulin stimulates the production of leptin when adipocytes are exposed to glucose to encourage satiety; while leptin, via a negative feedback, d...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00508

    authors: Lloret A,Monllor P,Esteve D,Cervera-Ferri A,Lloret MA

    更新日期:2019-05-22 00:00:00

  • Quantitative Profiling of Oxylipins in Acute Experimental Intracerebral Hemorrhage.

    abstract::Oxylipins are a series of bioactive lipid metabolites derived from polyunsaturated fatty acids that are involved in cerebral homeostasis and the development of intracerebral hemorrhage (ICH). However, comprehensive quantification of the oxylipin profile in ICH remains unknown. Therefore, an ICH mouse model was constru...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00777

    authors: Yuan JJ,Chen Q,Xiong XY,Zhang Q,Xie Q,Huang JC,Yang GQ,Gong CX,Qiu ZM,Sang HF,Zi WJ,He Q,Xu R,Yang QW

    更新日期:2020-09-23 00:00:00

  • Increases in muscle sympathetic nerve activity, heart rate, respiration, and skin blood flow during passive viewing of exercise.

    abstract::The cardiovascular and respiratory effects of exercise have been widely studied, as have the autonomic effects of imagined and observed exercise. However, the effects of observed exercise in the first person have not been documented, nor have direct recordings of muscle sympathetic nerve activity (MSNA) been obtained ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2013.00102

    authors: Brown R,Kemp U,Macefield V

    更新日期:2013-06-11 00:00:00

  • Cryptotanshinone Attenuates Inflammatory Response of Microglial Cells via the Nrf2/HO-1 Pathway.

    abstract::Cryptotanshinone (CTN), a monomer compound extracted from the dried roots and rhizomes of Salvia miltiorrhiza Bge, has a variety of pharmacological effects. However, little research has been done on the mechanism of CTN in attenuating neuroinflammation. The present study aimed to investigate whether CTN can ameliorate...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00852

    authors: Zhou Y,Wang X,Ying W,Wu D,Zhong P

    更新日期:2019-08-21 00:00:00

  • Closed-Loop Task Difficulty Adaptation during Virtual Reality Reach-to-Grasp Training Assisted with an Exoskeleton for Stroke Rehabilitation.

    abstract::Stroke patients with severe motor deficits of the upper extremity may practice rehabilitation exercises with the assistance of a multi-joint exoskeleton. Although this technology enables intensive task-oriented training, it may also lead to slacking when the assistance is too supportive. Preserving the engagement of t...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2016.00518

    authors: Grimm F,Naros G,Gharabaghi A

    更新日期:2016-11-15 00:00:00