GPUs Outperform Current HPC and Neuromorphic Solutions in Terms of Speed and Energy When Simulating a Highly-Connected Cortical Model.

Abstract:

:While neuromorphic systems may be the ultimate platform for deploying spiking neural networks (SNNs), their distributed nature and optimization for specific types of models makes them unwieldy tools for developing them. Instead, SNN models tend to be developed and simulated on computers or clusters of computers with standard von Neumann CPU architectures. Over the last decade, as well as becoming a common fixture in many workstations, NVIDIA GPU accelerators have entered the High Performance Computing field and are now used in 50 % of the Top 10 super computing sites worldwide. In this paper we use our GeNN code generator to re-implement two neo-cortex-inspired, circuit-scale, point neuron network models on GPU hardware. We verify the correctness of our GPU simulations against prior results obtained with NEST running on traditional HPC hardware and compare the performance with respect to speed and energy consumption against published data from CPU-based HPC and neuromorphic hardware. A full-scale model of a cortical column can be simulated at speeds approaching 0.5× real-time using a single NVIDIA Tesla V100 accelerator-faster than is currently possible using a CPU based cluster or the SpiNNaker neuromorphic system. In addition, we find that, across a range of GPU systems, the energy to solution as well as the energy per synaptic event of the microcircuit simulation is as much as 14× lower than either on SpiNNaker or in CPU-based simulations. Besides performance in terms of speed and energy consumption of the simulation, efficient initialization of models is also a crucial concern, particularly in a research context where repeated runs and parameter-space exploration are required. Therefore, we also introduce in this paper some of the novel parallel initialization methods implemented in the latest version of GeNN and demonstrate how they can enable further speed and energy advantages.

journal_name

Front Neurosci

authors

Knight JC,Nowotny T

doi

10.3389/fnins.2018.00941

subject

Has Abstract

pub_date

2018-12-12 00:00:00

pages

941

eissn

1662-4548

issn

1662-453X

journal_volume

12

pub_type

杂志文章
  • Preferred Tempo and Low-Audio-Frequency Bias Emerge From Simulated Sub-cortical Processing of Sounds With a Musical Beat.

    abstract::Prior research has shown that musical beats are salient at the level of the cortex in humans. Yet below the cortex there is considerable sub-cortical processing that could influence beat perception. Some biases, such as a tempo preference and an audio frequency bias for beat timing, could result from sub-cortical proc...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00349

    authors: Zuk NJ,Carney LH,Lalor EC

    更新日期:2018-05-29 00:00:00

  • Functional Studies of microRNAs in Neural Stem Cells: Problems and Perspectives.

    abstract::In adult mammals, neural stem cells (NSCs) are found in two niches of the brain; the subventricular zone by the lateral ventricles and the subgranular zone of the dentate gyrus in the hippocampus. Neurogenesis is a complex process that is tightly controlled on a molecular level. Recently, microRNAs (miRNAs) have been ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2012.00014

    authors: Akerblom M,Sachdeva R,Jakobsson J

    更新日期:2012-02-07 00:00:00

  • Pumilio Regulates Sleep Homeostasis in Response to Chronic Sleep Deprivation in Drosophila melanogaster.

    abstract::Recent studies have identified the Drosophila brain circuits involved in the sleep/wake switch and have pointed to the modulation of neuronal excitability as one of the underlying mechanisms triggering sleep need. In this study we aimed to explore the link between the homeostatic regulation of neuronal excitability an...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00319

    authors: De Jesús-Olmo LA,Rodríguez N,Francia M,Alemán-Rios J,Pacheco-Agosto CJ,Ortega-Torres J,Nieves R,Fuenzalida-Uribe N,Ghezzi A,Agosto JL

    更新日期:2020-04-17 00:00:00

  • STDP and STDP variations with memristors for spiking neuromorphic learning systems.

    abstract::In this paper we review several ways of realizing asynchronous Spike-Timing-Dependent-Plasticity (STDP) using memristors as synapses. Our focus is on how to use individual memristors to implement synaptic weight multiplications, in a way such that it is not necessary to (a) introduce global synchronization and (b) to ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2013.00002

    authors: Serrano-Gotarredona T,Masquelier T,Prodromakis T,Indiveri G,Linares-Barranco B

    更新日期:2013-02-18 00:00:00

  • Combining Robotic Training and Non-Invasive Brain Stimulation in Severe Upper Limb-Impaired Chronic Stroke Patients.

    abstract::Previous studies suggested that both robot-assisted rehabilitation and non-invasive brain stimulation can produce a slight improvement in severe chronic stroke patients. It is still unknown whether their combination can produce synergistic and more consistent improvements. Safety and efficacy of this combination has b...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2016.00088

    authors: Di Lazzaro V,Capone F,Di Pino G,Pellegrino G,Florio L,Zollo L,Simonetti D,Ranieri F,Brunelli N,Corbetto M,Miccinilli S,Bravi M,Milighetti S,Guglielmelli E,Sterzi S

    更新日期:2016-03-08 00:00:00

  • A Novel Audiovisual P300-Speller Paradigm Based on Cross-Modal Spatial and Semantic Congruence.

    abstract:Objective:Although many studies have attempted to improve the performance of the visual-based P300-speller system, its performance is still not satisfactory. The current system has limitations for patients with neurodegenerative diseases, in which muscular control of the eyes may be impaired or deteriorate over time. S...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.01040

    authors: Lu Z,Li Q,Gao N,Yang J,Bai O

    更新日期:2019-09-27 00:00:00

  • A Protocol to Evaluate Retinal Vascular Response Using Optical Coherence Tomography Angiography.

    abstract:Introduction:Optical coherence tomography angiography (OCT-A) is a novel diagnostic tool with increasing applications in ophthalmology clinics that provides non-invasive high-resolution imaging of the retinal microvasculature. Our aim is to report in detail an experimental protocol for analyzing both vasodilatory and v...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00566

    authors: Sousa DC,Leal I,Moreira S,do Vale S,Silva-Herdade AS,Aguiar P,Dionísio P,Abegão Pinto L,Castanho MARB,Marques-Neves C

    更新日期:2019-06-12 00:00:00

  • Phase-II Clinical Validation of a Powered Exoskeleton for the Treatment of Elbow Spasticity.

    abstract::Introduction: Spasticity is a typical motor disorder in patients affected by stroke. Typically post-stroke rehabilitation consists of repetition of mobilization exercises on impaired limbs, aimed to reduce muscle hypertonia and mitigate spastic reflexes. It is currently strongly debated if the treatment's effectivenes...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00261

    authors: Crea S,Cempini M,Mazzoleni S,Carrozza MC,Posteraro F,Vitiello N

    更新日期:2017-05-12 00:00:00

  • Estrogen Protects Neurotransmission Transcriptome During Status Epilepticus.

    abstract::Women with epilepsy commonly have premature onset of menopause. The decrease in estrogen levels is associated with increased occurrence of neurodegenerative processes and cognitive decline. Previously, we found that estradiol (E2) replacement in ovariectomized (OVX) female rats significantly reduced the seizure-relate...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00332

    authors: Iacobas DA,Iacobas S,Nebieridze N,Velíšek L,Velíšková J

    更新日期:2018-06-20 00:00:00

  • P300 Analysis Using High-Density EEG to Decipher Neural Response to rTMS in Patients With Schizophrenia and Auditory Verbal Hallucinations.

    abstract::Schizophrenia is a complex disorder about which much is still unknown. Potential treatments, such as transcranial magnetic stimulation (TMS), have not been exploited, in part because of the variability in behavioral response. This can be overcome with the use of response biomarkers. It has been however shown that repe...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.575538

    authors: Aubonnet R,Banea OC,Sirica R,Wassermann EM,Yassine S,Jacob D,Magnúsdóttir BB,Haraldsson M,Stefansson SB,Jónasson VD,Ívarsson E,Jónasson AD,Hassan M,Gargiulo P

    更新日期:2020-11-20 00:00:00

  • Brain Map of Intrinsic Functional Flexibility in Anesthetized Monkeys and Awake Humans.

    abstract::Emerging neuroimaging studies emphasize the dynamic organization of spontaneous brain activity in both human and non-human primates, even under anesthesia. In a recent study, we were able to characterize the heterogeneous architecture of intrinsic functional flexibility in the awake, resting human brain using time-res...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00174

    authors: Yin D,Zhang Z,Wang Z,Zeljic K,Lv Q,Cai D,Wang Y,Wang Z

    更新日期:2019-02-28 00:00:00

  • The Alzheimer's Disease-Associated R47H Variant of TREM2 Has an Altered Glycosylation Pattern and Protein Stability.

    abstract::The R47H coding variant of the triggering receptor expressed on myeloid cells-2 (TREM2) increases the risk of Alzheimer's disease (AD) similar to apolipoprotein E4. TREM2 R47H has recently been shown to have impaired binding to damage-associated lipid or apolipoprotein ligands. However, it is not known how this R47H v...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2016.00618

    authors: Park JS,Ji IJ,Kim DH,An HJ,Yoon SY

    更新日期:2017-01-18 00:00:00

  • Open Science Meets Stem Cells: A New Drug Discovery Approach for Neurodegenerative Disorders.

    abstract::Neurodegenerative diseases are a challenge for drug discovery, as the biological mechanisms are complex and poorly understood, with a paucity of models that faithfully recapitulate these disorders. Recent advances in stem cell technology have provided a paradigm shift, providing researchers with tools to generate huma...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2018.00047

    authors: Han C,Chaineau M,Chen CX,Beitel LK,Durcan TM

    更新日期:2018-02-06 00:00:00

  • Ambiguity aversion in rhesus macaques.

    abstract::People generally prefer risky options, which have fully specified outcome probabilities, to ambiguous options, which have unspecified probabilities. This preference, formalized in economics, is strong enough that people will reliably prefer a risky option to an ambiguous option with a greater expected value. Explanati...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2010.00166

    authors: Hayden BY,Heilbronner SR,Platt ML

    更新日期:2010-09-17 00:00:00

  • Deciding which way to go: how do insects alter movements to negotiate barriers?

    abstract::Animals must routinely deal with barriers as they move through their natural environment. These challenges require directed changes in leg movements and posture performed in the context of ever changing internal and external conditions. In particular, cockroaches use a combination of tactile and visual information to ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2012.00097

    authors: Ritzmann RE,Harley CM,Daltorio KA,Tietz BR,Pollack AJ,Bender JA,Guo P,Horomanski AL,Kathman ND,Nieuwoudt C,Brown AE,Quinn RD

    更新日期:2012-07-06 00:00:00

  • The behavioral relevance of multisensory neural response interactions.

    abstract::Sensory information can interact to impact perception and behavior. Foods are appreciated according to their appearance, smell, taste and texture. Athletes and dancers combine visual, auditory, and somatosensory information to coordinate their movements. Under laboratory settings, detection and discrimination are like...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/neuro.01.009.2010

    authors: Sperdin HF,Cappe C,Murray MM

    更新日期:2010-05-15 00:00:00

  • Low Cost Interconnected Architecture for the Hardware Spiking Neural Networks.

    abstract::A novel low cost interconnected architecture (LCIA) is proposed in this paper, which is an efficient solution for the neuron interconnections for the hardware spiking neural networks (SNNs). It is based on an all-to-all connection that takes each paired input and output nodes of multi-layer SNNs as the source and dest...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00857

    authors: Luo Y,Wan L,Liu J,Harkin J,McDaid L,Cao Y,Ding X

    更新日期:2018-11-21 00:00:00

  • Pyff - a pythonic framework for feedback applications and stimulus presentation in neuroscience.

    abstract::This paper introduces Pyff, the Pythonic feedback framework for feedback applications and stimulus presentation. Pyff provides a platform-independent framework that allows users to develop and run neuroscientific experiments in the programming language Python. Existing solutions have mostly been implemented in C++, wh...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2010.00179

    authors: Venthur B,Scholler S,Williamson J,Dähne S,Treder MS,Kramarek MT,Müller KR,Blankertz B

    更新日期:2010-12-02 00:00:00

  • The Experimental Oxime K027-A Promising Protector From Organophosphate Pesticide Poisoning. A Review Comparing K027, K048, Pralidoxime, and Obidoxime.

    abstract::Poisoning with organophosphorus compounds (OPCs) is a major problem worldwide. Standard therapy with atropine and established oxime-type enzyme reactivators (pralidoxime, obidoxime) is unsatisfactory. In search of more efficacious broad-spectrum oximes, new bispyridinium (K-) oximes have been synthesized, with K027 be...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2019.00427

    authors: Lorke DE,Petroianu GA

    更新日期:2019-05-22 00:00:00

  • Evolutionary Elongation of the Time Window of Integration in Auditory Cortex: Macaque vs. Human Comparison of the Effects of Sound Duration on Auditory Evoked Potentials.

    abstract::The auditory cortex integrates auditory information over time to obtain neural representations of sound events, the time scale of which critically affects perception. This work investigated the species differences in the time scale of integration by comparing humans and monkeys regarding how their scalp-recorded corti...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00630

    authors: Itoh K,Nejime M,Konoike N,Nakamura K,Nakada T

    更新日期:2019-06-24 00:00:00

  • Toward a Bidirectional Communication Between Retinal Cells and a Prosthetic Device - A Proof of Concept.

    abstract::Background: Significant progress toward the recovery of useful vision in blind patients with severe degenerative retinal diseases caused by photoreceptor death has been achieved with the development of visual prostheses that stimulate the retina electrically. However, currently used prostheses do not provide feedback ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00367

    authors: Rincón Montes V,Gehlen J,Lück S,Mokwa W,Müller F,Walter P,Offenhäusser A

    更新日期:2019-04-30 00:00:00

  • The Drosophila blood-brain barrier: development and function of a glial endothelium.

    abstract::The efficacy of neuronal function requires a well-balanced extracellular ion homeostasis and a steady supply with nutrients and metabolites. Therefore, all organisms equipped with a complex nervous system developed a so-called blood-brain barrier, protecting it from an uncontrolled entry of solutes, metabolites or pat...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2014.00365

    authors: Limmer S,Weiler A,Volkenhoff A,Babatz F,Klämbt C

    更新日期:2014-11-14 00:00:00

  • Toll-like receptors as developmental tools that regulate neurogenesis during development: an update.

    abstract::Neurogenesis, the process of generating new neurons in the brain, fascinates researchers for its promise to affect multiple cognitive and functional processes in both health and disease. Many cellular pathways are involved in the regulation of neurogenesis, a complexity exemplified by the extensive regulation of this ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2014.00272

    authors: Barak B,Feldman N,Okun E

    更新日期:2014-08-28 00:00:00

  • Early Pain Exposure Influences Functional Brain Connectivity in Very Preterm Neonates.

    abstract:Background:Early exposure to nociceptive events may cause brain structural alterations in preterm neonates, with long-lasting consequences on neurodevelopmental outcome. Little is known on the extent to which early pain may affect brain connectivity. We aim to evaluate brain functional connectivity changes in preterm n...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00899

    authors: Tortora D,Severino M,Di Biase C,Malova M,Parodi A,Minghetti D,Traggiai C,Uccella S,Boeri L,Morana G,Rossi A,Ramenghi LA

    更新日期:2019-08-23 00:00:00

  • Broad Lipidomic and Transcriptional Changes of Prophylactic PEA Administration in Adult Mice.

    abstract::Beside diverse therapeutic properties of palmitoylethanolamide (PEA) including: neuroprotection, inflammation and pain alleviation, prophylactic effects have also been reported in animal models of infections, inflammation, and neurological diseases. The availability of PEA as (ultra)micronized nutraceutical formulatio...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00527

    authors: Lerner R,Pascual Cuadrado D,Post JM,Lutz B,Bindila L

    更新日期:2019-06-11 00:00:00

  • The Impact of Single Session Intermittent Theta-Burst Stimulation over the Dorsolateral Prefrontal Cortex and Posterior Superior Temporal Sulcus on Adults with Autism Spectrum Disorder.

    abstract::Intermittent theta burst stimulation (iTBS), a patterned repetitive transcranial magnetic stimulation, was applied over the posterior superior temporal sulcus (pSTS) or dorsolateral prefrontal cortex (DLPFC) to explore its impact in adults with autism spectrum disorder (ASD). Among 25 adults with ASD, 19 (mean age: 20...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00255

    authors: Ni HC,Hung J,Wu CT,Wu YY,Chang CJ,Chen RS,Huang YZ

    更新日期:2017-05-09 00:00:00

  • Structural and Functional Brain Connectivity Changes Between People With Abdominal and Non-abdominal Obesity and Their Association With Behaviors of Eating Disorders.

    abstract::Abdominal obesity is important for understanding obesity, which is a worldwide medical problem. We explored structural and functional brain differences in people with abdominal and non-abdominal obesity by using multimodal neuroimaging and up-to-date analysis methods. A total of 274 overweight people, whose body mass ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00741

    authors: Park BY,Lee MJ,Kim M,Kim SH,Park H

    更新日期:2018-10-11 00:00:00

  • Integration of Descending Command Systems for the Generation of Context-Specific Locomotor Behaviors.

    abstract::Over the past decade there has been a renaissance in our understanding of spinal cord circuits; new technologies are beginning to provide key insights into descending circuits which project onto spinal cord central pattern generators. By integrating work from both the locomotor and animal behavioral fields, we can now...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2017.00581

    authors: Kim LH,Sharma S,Sharples SA,Mayr KA,Kwok CHT,Whelan PJ

    更新日期:2017-10-18 00:00:00

  • The Effects of 10 Hz Transcranial Alternating Current Stimulation on Audiovisual Task Switching.

    abstract::Neural oscillations in the alpha band (7-13 Hz) are commonly associated with disengagement of visual attention. However, recent studies have also associated alpha with processes of attentional control and stability. We addressed this issue in previous experiments by delivering transcranial alternating current stimulat...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00067

    authors: Clayton MS,Yeung N,Cohen Kadosh R

    更新日期:2018-02-13 00:00:00

  • A comparative, developmental, and clinical perspective of neurobehavioral sexual dimorphisms.

    abstract::Women and men differ in a wide variety of behavioral traits and in their vulnerability to developing certain mental disorders. This review endeavors to explore how recent preclinical and clinical research findings have enhanced our understanding of the factors that underlie these disparities. We start with a brief ove...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2012.00084

    authors: Viveros MP,Mendrek A,Paus T,López-Rodríguez AB,Marco EM,Yehuda R,Cohen H,Lehrner A,Wagner EJ

    更新日期:2012-06-12 00:00:00