Bitstream-Based Neural Network for Scalable, Efficient, and Accurate Deep Learning Hardware.

Abstract:

:While convolutional neural networks (CNNs) continue to renew state-of-the-art performance across many fields of machine learning, their hardware implementations tend to be very costly and inflexible. Neuromorphic hardware, on the other hand, targets higher efficiency but their inference accuracy lags far behind that of CNNs. To bridge the gap between deep learning and neuromorphic computing, we present bitstream-based neural network, which is both efficient and accurate as well as being flexible in terms of arithmetic precision and hardware size. Our bitstream-based neural network (called SC-CNN) is built on top of CNN but inspired by stochastic computing (SC), which uses bitstreams to represent numbers. Being based on CNN, our SC-CNN can be trained with backpropagation, ensuring very high inference accuracy. At the same time our SC-CNN is deterministic, hence repeatable, and is highly accurate and scalable even to large networks. Our experimental results demonstrate that our SC-CNN is highly accurate up to ImageNet-targeting CNNs, and improves efficiency over conventional digital designs ranging through 50-100% in operations-per-area depending on the CNN and the application scenario, while losing <1% in recognition accuracy. In addition, our SC-CNN implementations can be much more fault-tolerant than conventional digital implementations.

journal_name

Front Neurosci

authors

Sim H,Lee J

doi

10.3389/fnins.2020.543472

subject

Has Abstract

pub_date

2020-12-23 00:00:00

pages

543472

eissn

1662-4548

issn

1662-453X

journal_volume

14

pub_type

杂志文章
  • On event-based optical flow detection.

    abstract::Event-based sensing, i.e., the asynchronous detection of luminance changes, promises low-energy, high dynamic range, and sparse sensing. This stands in contrast to whole image frame-wise acquisition by standard cameras. Here, we systematically investigate the implications of event-based sensing in the context of visua...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2015.00137

    authors: Brosch T,Tschechne S,Neumann H

    更新日期:2015-04-20 00:00:00

  • Double Flash Illusions: Current Findings and Future Directions.

    abstract::Twenty years ago, the first report on the sound-induced double flash illusion, a visual illusion induced by sound, was published. In this paradigm, participants are presented with different numbers of auditory and visual stimuli. In case of an incongruent number of auditory and visual stimuli, the influence of auditor...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2020.00298

    authors: Keil J

    更新日期:2020-04-03 00:00:00

  • The Role of Astrocytes in the Generation, Migration, and Integration of New Neurons in the Adult Olfactory Bulb.

    abstract::In mammals, new neurons in the adult olfactory bulb originate from a pool of neural stem cells in the subventricular zone of the lateral ventricles. Adult-born cells play an important role in odor information processing by adjusting the neuronal network to changing environmental conditions. Olfactory bulb neurogenesis...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2016.00149

    authors: Gengatharan A,Bammann RR,Saghatelyan A

    更新日期:2016-04-05 00:00:00

  • A Protocol to Evaluate Retinal Vascular Response Using Optical Coherence Tomography Angiography.

    abstract:Introduction:Optical coherence tomography angiography (OCT-A) is a novel diagnostic tool with increasing applications in ophthalmology clinics that provides non-invasive high-resolution imaging of the retinal microvasculature. Our aim is to report in detail an experimental protocol for analyzing both vasodilatory and v...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00566

    authors: Sousa DC,Leal I,Moreira S,do Vale S,Silva-Herdade AS,Aguiar P,Dionísio P,Abegão Pinto L,Castanho MARB,Marques-Neves C

    更新日期:2019-06-12 00:00:00

  • Attention-deficit hyperactivity disorder (ADHD) stimulant medications as cognitive enhancers.

    abstract::Recent increases in attention deficit hyperactivity disorder (ADHD) diagnoses, and the escalation of stimulant prescriptions, has raised concern about diversion and abuse of stimulants, as well as the ethics of using these drugs as "cognitive enhancers."Such concern appears misplaced in the face of substantial evidenc...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2013.00082

    authors: Advokat C,Scheithauer M

    更新日期:2013-05-29 00:00:00

  • Robustness and Vulnerability of the Autoregulatory System That Maintains Nuclear TDP-43 Levels: A Trade-off Hypothesis for ALS Pathology Based on in Silico Data.

    abstract::Abnormal accumulation of TAR DNA-binding protein 43 (TDP-43) in the cytoplasm and its disappearance from the nucleus are pathological features of amyotrophic lateral sclerosis and frontotemporal dementia (ALS/FTD) and are directly involved in the pathogenesis of these conditions. TDP-43 is an essential nuclear protein...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00028

    authors: Sugai A,Kato T,Koyama A,Koike Y,Kasahara S,Konno T,Ishihara T,Onodera O

    更新日期:2018-02-01 00:00:00

  • The behavioral relevance of multisensory neural response interactions.

    abstract::Sensory information can interact to impact perception and behavior. Foods are appreciated according to their appearance, smell, taste and texture. Athletes and dancers combine visual, auditory, and somatosensory information to coordinate their movements. Under laboratory settings, detection and discrimination are like...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/neuro.01.009.2010

    authors: Sperdin HF,Cappe C,Murray MM

    更新日期:2010-05-15 00:00:00

  • Does neuroinflammation turn on the flame in Alzheimer's disease? Focus on astrocytes.

    abstract::Data from animal models and Alzheimer's disease (AD) subjects provide clear evidence for an activation of inflammatory pathways during the pathogenetic course of such illness. Biochemical and neuropathological studies highlighted an important cause/effect relationship between inflammation and AD progression, revealing...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2015.00259

    authors: Steardo L Jr,Bronzuoli MR,Iacomino A,Esposito G,Steardo L,Scuderi C

    更新日期:2015-07-29 00:00:00

  • T Cell Responses to Neural Autoantigens Are Similar in Alzheimer's Disease Patients and Age-Matched Healthy Controls.

    abstract::Alzheimer's disease (AD), a chronic multifactorial and complex neurodegenerative disorder is a leading cause of dementia. Recently, neuroinflammation has been hypothesized as a contributing factor to AD pathogenesis. The role of adaptive immune responses against neuronal antigens, which can either confer protection or...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00874

    authors: Dhanwani R,Pham J,Premlal ALR,Frazier A,Kumar A,Pero ME,Bartolini F,Dutra JR,Marder KS,Peters B,Sulzer D,Sette A,Lindestam Arlehamn CS

    更新日期:2020-08-27 00:00:00

  • Striatal and Tegmental Neurons Code Critical Signals for Temporal-Difference Learning of State Value in Domestic Chicks.

    abstract::To ensure survival, animals must update the internal representations of their environment in a trial-and-error fashion. Psychological studies of associative learning and neurophysiological analyses of dopaminergic neurons have suggested that this updating process involves the temporal-difference (TD) method in the bas...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2016.00476

    authors: Wen C,Ogura Y,Matsushima T

    更新日期:2016-11-08 00:00:00

  • sPyNNaker: A Software Package for Running PyNN Simulations on SpiNNaker.

    abstract::This work presents sPyNNaker 4.0.0, the latest version of the software package for simulating PyNN-defined spiking neural networks (SNNs) on the SpiNNaker neuromorphic platform. Operations underpinning realtime SNN execution are presented, including an event-based operating system facilitating efficient time-driven ne...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00816

    authors: Rhodes O,Bogdan PA,Brenninkmeijer C,Davidson S,Fellows D,Gait A,Lester DR,Mikaitis M,Plana LA,Rowley AGD,Stokes AB,Furber SB

    更新日期:2018-11-20 00:00:00

  • Genome Wide Association Study and Next Generation Sequencing: A Glimmer of Light Toward New Possible Horizons in Frontotemporal Dementia Research.

    abstract::Frontotemporal Dementia (FTD) is a focal neurodegenerative disease, with a strong genetic background, that causes early onset dementia. The present knowledge about the risk loci and causative mutations of FTD mainly derives from genetic linkage analysis, studies of candidate genes, Genome-Wide Association Studies (GWA...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2019.00506

    authors: Ciani M,Benussi L,Bonvicini C,Ghidoni R

    更新日期:2019-05-16 00:00:00

  • Cytoplasmic dynein and its regulatory proteins in Golgi pathology in nervous system disorders.

    abstract::The Golgi apparatus is a dynamic organelle involved in processing and sorting of lipids and proteins. In neurons, the Golgi apparatus is important for the development of axons and dendrites and maintenance of their highly complex polarized morphology. The motor protein complex cytoplasmic dynein has an important role ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2015.00397

    authors: Jaarsma D,Hoogenraad CC

    更新日期:2015-10-26 00:00:00

  • Supplemental Stimulation Improves Swing Phase Kinematics During Exoskeleton Assisted Gait of SCI Subjects With Severe Muscle Spasticity.

    abstract::Spasticity is a common comorbidity associated with spinal cord injury (SCI). Robotic exoskeletons have recently emerged to facilitate legged mobility in people with motor complete SCI. Involuntary muscle activity attributed to spasticity, however, can prevent such individuals from using an exoskeleton. Specifically, a...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.00374

    authors: Ekelem A,Goldfarb M

    更新日期:2018-06-01 00:00:00

  • Acute Social Defeat Stress Increases Sleep in Mice.

    abstract::Social conflict is a major source of stress in humans. Animals also experience social conflicts and cope with them by stress responses that facilitate arousal and activate sympathetic and neuroendocrine systems. The effect of acute social defeat (SoD) stress on the sleep/wake behavior of mice has been reported in seve...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00322

    authors: Fujii S,Kaushik MK,Zhou X,Korkutata M,Lazarus M

    更新日期:2019-04-03 00:00:00

  • The Alzheimer's Disease-Associated R47H Variant of TREM2 Has an Altered Glycosylation Pattern and Protein Stability.

    abstract::The R47H coding variant of the triggering receptor expressed on myeloid cells-2 (TREM2) increases the risk of Alzheimer's disease (AD) similar to apolipoprotein E4. TREM2 R47H has recently been shown to have impaired binding to damage-associated lipid or apolipoprotein ligands. However, it is not known how this R47H v...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2016.00618

    authors: Park JS,Ji IJ,Kim DH,An HJ,Yoon SY

    更新日期:2017-01-18 00:00:00

  • 5-HT2A Gene Variants Moderate the Association between PTSD and Reduced Default Mode Network Connectivity.

    abstract::The default mode network (DMN) has been used to study disruptions of functional connectivity in a wide variety of psychiatric and neurological conditions, including posttraumatic stress disorder (PTSD). Studies indicate that the serotonin system exerts a modulatory influence on DMN connectivity; however, no prior stud...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2016.00299

    authors: Miller MW,Sperbeck E,Robinson ME,Sadeh N,Wolf EJ,Hayes JP,Logue M,Schichman SA,Stone A,Milberg W,McGlinchey R

    更新日期:2016-06-28 00:00:00

  • Atrial Fibrillation and Risk of Dementia: Epidemiology, Mechanisms, and Effect of Anticoagulation.

    abstract::Atrial fibrillation (AF) is one of the cardiovascular risk factors for dementia. Several longitudinal studies have reported an association between AF and dementia independently of stroke history. Although the mechanisms underlying this association are not fully understood, proposed mechanisms include cerebral hypoperf...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2019.00018

    authors: Silva RMFLD,Miranda CM,Liu T,Tse G,Roever L

    更新日期:2019-01-31 00:00:00

  • Design of an Adaptive Human-Machine System Based on Dynamical Pattern Recognition of Cognitive Task-Load.

    abstract::This paper developed a cognitive task-load (CTL) classification algorithm and allocation strategy to sustain the optimal operator CTL levels over time in safety-critical human-machine integrated systems. An adaptive human-machine system is designed based on a non-linear dynamic CTL classifier, which maps a set of elec...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2017.00129

    authors: Zhang J,Yin Z,Wang R

    更新日期:2017-03-17 00:00:00

  • Frequency-Following Responses to Complex Tones at Different Frequencies Reflect Different Source Configurations.

    abstract::The neural generators of the frequency-following response (FFR), a neural response widely used to study the human auditory system, remain unclear. There is evidence that the balance between cortical and subcortical contributions to the FFR varies with stimulus frequency. In this study, we tried to clarify whether this...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00130

    authors: Zhang X,Gong Q

    更新日期:2019-02-26 00:00:00

  • Broad Lipidomic and Transcriptional Changes of Prophylactic PEA Administration in Adult Mice.

    abstract::Beside diverse therapeutic properties of palmitoylethanolamide (PEA) including: neuroprotection, inflammation and pain alleviation, prophylactic effects have also been reported in animal models of infections, inflammation, and neurological diseases. The availability of PEA as (ultra)micronized nutraceutical formulatio...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00527

    authors: Lerner R,Pascual Cuadrado D,Post JM,Lutz B,Bindila L

    更新日期:2019-06-11 00:00:00

  • Mutations and Modeling of the Chromatin Remodeler CHD8 Define an Emerging Autism Etiology.

    abstract::Autism Spectrum Disorder (ASD) is a common neurodevelopmental disorder with a strong but complex genetic component. Recent family based exome-sequencing strategies have identified recurrent de novo mutations at specific genes, providing strong evidence for ASD risk, but also highlighting the extreme genetic heterogene...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2015.00477

    authors: Barnard RA,Pomaville MB,O'Roak BJ

    更新日期:2015-12-17 00:00:00

  • Glucocorticoid Regulation of Food-Choice Behavior in Humans: Evidence from Cushing's Syndrome.

    abstract::The mechanisms by which glucocorticoids regulate food intake and resulting body mass in humans are not well-understood. One potential mechanism could involve modulation of reward processing, but human stress models examining effects of glucocorticoids on behavior contain important confounds. Here, we studied individua...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2016.00021

    authors: Moeller SJ,Couto L,Cohen V,Lalazar Y,Makotkine I,Williams N,Yehuda R,Goldstein RZ,Geer EB

    更新日期:2016-02-05 00:00:00

  • Autism Pathogenesis: The Superior Colliculus.

    abstract::After been exposed to the visual input, in the first year of life, the brain experiences subtle but massive changes apparently crucial for communicative/emotional and social human development. Its lack could be the explanation of the very high prevalence of autism in children with total congenital blindness. The prese...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2018.01029

    authors: Jure R

    更新日期:2019-01-09 00:00:00

  • Neuromodulation of the Pineal Gland via Electrical Stimulation of Its Sympathetic Innervation Pathway.

    abstract::Stimulation of the pineal gland via its sympathetic innervation pathway results in the production of N-acetylserotonin and melatonin. Melatonin has many therapeutic roles and is heavily implicated in the regulation of the sleep-wake cycle. In addition, N-acetylserotonin has recently been reported to promote neurogenes...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2020.00264

    authors: Lumsden SC,Clarkson AN,Cakmak YO

    更新日期:2020-04-02 00:00:00

  • Computational detection of alternative exon usage.

    abstract:BACKGROUND:With the advent of the GeneChip Exon Arrays, it is now possible to extract "exon-level" expression estimates, allowing for detection of alternative splicing events, one of the primary mechanisms of transcript diversity. In the context of (1) a complex trait use case and (2) a human cerebellum vs. heart compa...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2011.00069

    authors: Laderas TG,Walter NA,Mooney M,Vartanian K,Darakjian P,Buck K,Harrington CA,Belknap J,Hitzemann R,McWeeney SK

    更新日期:2011-05-13 00:00:00

  • Foveal Therapy in Blue Cone Monochromacy: Predictions of Visual Potential From Artificial Intelligence.

    abstract::Novel therapeutic approaches for treating inherited retinal degenerations (IRDs) prompt a need to understand which patients with impaired vision have the anatomical potential to gain from participation in a clinical trial. We used supervised machine learning to predict foveal function from foveal structure in blue con...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2020.00800

    authors: Sumaroka A,Cideciyan AV,Sheplock R,Wu V,Kohl S,Wissinger B,Jacobson SG

    更新日期:2020-08-03 00:00:00

  • The Potential Roles of Ghrelin in Metabolic Syndrome and Secondary Symptoms of Alzheimer's Disease.

    abstract::Although the major causative factors of Alzheimer's disease (AD) are the accumulation of amyloid β and hyperphosphorylated tau, AD can also be caused by metabolic dysfunction. The major clinical symptom of AD is cognitive dysfunction. However, AD is also accompanied by various secondary symptoms such as depression, sl...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnins.2020.583097

    authors: Kim S,Nam Y,Shin SJ,Park YH,Jeon SG,Kim JI,Kim MJ,Moon M

    更新日期:2020-09-24 00:00:00

  • Corrigendum: Large-Scale Neuromorphic Spiking Array Processors: A Quest to Mimic the Brain.

    abstract::[This corrects the article DOI: 10.3389/fnins.2018.00891.]. ...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章,已发布勘误

    doi:10.3389/fnins.2018.00991

    authors: Thakur CS,Molin JL,Cauwenberghs G,Indiveri G,Kumar K,Qiao N,Schemmel J,Wang R,Chicca E,Hasler JO,Seo JS,Yu S,Cao Y,van Schaik A,Etienne-Cummings R

    更新日期:2019-01-07 00:00:00

  • Expressional Profiling of Carpet Glia in the Developing Drosophila Eye Reveals Its Molecular Signature of Morphology Regulators.

    abstract::Homeostasis in the nervous system requires intricate regulation and is largely accomplished by the blood-brain barrier (BBB). The major gate keeper of the vertebrate BBB is vascular endothelial cells, which form tight junctions (TJs). To gain insight into the development of the BBB, we studied the carpet glia, a subpe...

    journal_title:Frontiers in neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnins.2019.00244

    authors: Ho TY,Wu WH,Hung SJ,Liu T,Lee YM,Liu YH

    更新日期:2019-03-29 00:00:00