Abstract:
:Artificial neural networks (ANNs) trained using backpropagation are powerful learning architectures that have achieved state-of-the-art performance in various benchmarks. Significant effort has been devoted to developing custom silicon devices to accelerate inference in ANNs. Accelerating the training phase, however, has attracted relatively little attention. In this paper, we describe a hardware-efficient on-line learning technique for feedforward multi-layer ANNs that is based on pipelined backpropagation. Learning is performed in parallel with inference in the forward pass, removing the need for an explicit backward pass and requiring no extra weight lookup. By using binary state variables in the feedforward network and ternary errors in truncated-error backpropagation, the need for any multiplications in the forward and backward passes is removed, and memory requirements for the pipelining are drastically reduced. Further reduction in addition operations owing to the sparsity in the forward neural and backpropagating error signal paths contributes to highly efficient hardware implementation. For proof-of-concept validation, we demonstrate on-line learning of MNIST handwritten digit classification on a Spartan 6 FPGA interfacing with an external 1Gb DDR2 DRAM, that shows small degradation in test error performance compared to an equivalently sized binary ANN trained off-line using standard back-propagation and exact errors. Our results highlight an attractive synergy between pipelined backpropagation and binary-state networks in substantially reducing computation and memory requirements, making pipelined on-line learning practical in deep networks.
journal_name
Front Neuroscijournal_title
Frontiers in neuroscienceauthors
Mostafa H,Pedroni B,Sheik S,Cauwenberghs Gdoi
10.3389/fnins.2017.00496subject
Has Abstractpub_date
2017-09-06 00:00:00pages
496eissn
1662-4548issn
1662-453Xjournal_volume
11pub_type
杂志文章abstract::Self-control exertion on an initial task has been associated with impaired performance on subsequent physical tasks also requiring self-control; an effect suggested to be mediated by changes in perceptions of pain and motivation. However, the effects of spending longer on the initial self-control task are unknown. Thi...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2020.571312
更新日期:2020-10-08 00:00:00
abstract::Cellular respiration is a vital process for the existence of life. Any condition that results in deprivation of oxygen (also termed as hypoxia) may eventually lead to deleterious effects on the functioning of tissues. Brain being the highest consumer of oxygen is prone to increased risk of hypoxia-induced neurological...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章,评审
doi:10.3389/fnins.2017.00386
更新日期:2017-07-11 00:00:00
abstract::Vagal neurocircuits are vitally important in the co-ordination and modulation of GI reflexes and homeostatic functions. 5-hydroxytryptamine (5-HT; serotonin) is critically important in the regulation of several of these autonomic gastrointestinal (GI) functions including motility, secretion and visceral sensitivity. W...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章,评审
doi:10.3389/fnins.2015.00413
更新日期:2015-10-29 00:00:00
abstract::Diffusion magnetic resonance imaging (dMRI) allows to reconstruct the main pathways of axons within the white matter of the brain as a set of polylines, called streamlines. The set of streamlines of the whole brain is called the tractogram. Organizing tractograms into anatomically meaningful structures, called tracts,...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2017.00754
更新日期:2018-02-06 00:00:00
abstract::Asiatic acid (AA), a pentacyclic triterpene derived from the tropical medicinal plant Centella asiatica, has been widely used as an antioxidant and anti-inflammatory agent. Evidence regarding the neuroprotective properties of AA is emerging. However, the protective effects of AA and its mechanism in glaucoma are poorl...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2018.00489
更新日期:2018-07-20 00:00:00
abstract::Perception is an active process that interprets and structures the stimulus input based on assumptions about its possible causes. We use real-time functional magnetic resonance imaging (rtfMRI) to investigate a particularly powerful demonstration of dynamic object integration in which the same physical stimulus interm...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2014.00116
更新日期:2014-05-23 00:00:00
abstract::Adult neurogenesis is a tightly regulated process continuously taking place in the central nervous system of most mammalian species. In neuroscience research, transgenic animals bearing the tamoxifen-inducible CreERT2-Lox system are widely used. In this study, we made use of a Nestin-CreERT2/R26R-YFP transgenic mouse ...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2017.00027
更新日期:2017-02-01 00:00:00
abstract::We generally experience a stable visual world in spite of regular disruptions caused by our own movements (saccades, blinks) or by the visual input itself (flashes, occlusions). In trying to understand the mechanisms responsible for this stability, saccades have been particularly well-studied, and a number of peri-sac...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2020.00217
更新日期:2020-03-17 00:00:00
abstract::Recent non-invasive brain stimulation techniques in combination with motor training can enhance neuroplasticity and learning. It is reasonable to assume that such neuroplasticity-based interventions constitute a useful rehabilitative tool for patients with Parkinson's Disease (PD). Regarding motor skill training, many...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2019.00602
更新日期:2019-06-19 00:00:00
abstract::Orexins are hypothalamic neuropeptides that were initially identified in the rat brain as endogenous ligands for an (previously) orphan G-protein-coupled receptor (GPCR). They are multitasking peptides involved in many physiological functions, including regulation of feeding behavior, wakefulness and autonomic/neuroen...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章,评审
doi:10.3389/fnins.2020.00691
更新日期:2020-07-10 00:00:00
abstract::The formation of the six-layered structure of the mammalian cortex via the inside-out pattern of neuronal migration is fundamental to neocortical functions. Extracellular cues such as Reelin induce intracellular signaling cascades through the protein phosphorylation. Migrating neurons also have intrinsic machineries t...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章,评审
doi:10.3389/fnins.2014.00458
更新日期:2015-01-13 00:00:00
abstract::Retinal and cortical mechanisms provide for persistence of visual information across intervals of many hundreds of milliseconds, which supports the integration of partial shape cues. The present experiments displayed unknown shapes in a match recognition task, wherein a target shape was quickly followed by a compariso...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2019.00178
更新日期:2019-03-13 00:00:00
abstract::Purinergic signaling is critically involved in neuroinflammation associated with multiple sclerosis (MS) and its major inflammatory animal model, experimental autoimmune encephalomyelitis (EAE). Herein, we explored the expression of ectonucleoside triphosphate diphosphohydrolase1 (NTPDase1/CD39) in the spinal cord, at...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2019.00410
更新日期:2019-04-26 00:00:00
abstract::The recently renewed focus on the human exploration of outer space has boosted the interest toward a variety of questions regarding health of astronauts and cosmonauts. Among the others, sleep has traditionally been considered a central issue. To extend the research chances, human sleep alterations have been investiga...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章,评审
doi:10.3389/fnins.2020.00851
更新日期:2020-08-11 00:00:00
abstract::Functional magnetic resonance imaging (fMRI) is a powerful noninvasive tool for studying spontaneous resting state functional connectivity (RSFC) in laboratory animals. Brain function can be significantly affected by generally used anesthetics, however, rendering the need for awake imaging. Only a few different awake ...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2018.00548
更新日期:2018-08-20 00:00:00
abstract::Uncovering brain activity from magnetoencephalography (MEG) data requires solving an ill-posed inverse problem, greatly confounded by noise, interference, and correlated sources. Sparse reconstruction algorithms, such as Champagne, show great promise in that they provide focal brain activations robust to these confoun...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2012.00186
更新日期:2012-12-26 00:00:00
abstract::Electroencephalography (EEG) is perhaps the most widely used brain-imaging technique for pediatric populations. However, EEG signals are prone to distortion by motion. Compared to adults, infants' motion is both more frequent and less stereotypical yet motion effects on the infant EEG signal are largely undocumented. ...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2020.00352
更新日期:2020-04-28 00:00:00
abstract::Probability and risk are important factors for value-based decision making and optimal foraging. In order to survive in an unpredictable world, organisms must be able to assess the probability and risk attached to future events and use this information to generate adaptive behavior. Recent studies in non-human primate...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2011.00121
更新日期:2011-10-11 00:00:00
abstract::The neural generators of the frequency-following response (FFR), a neural response widely used to study the human auditory system, remain unclear. There is evidence that the balance between cortical and subcortical contributions to the FFR varies with stimulus frequency. In this study, we tried to clarify whether this...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2019.00130
更新日期:2019-02-26 00:00:00
abstract::Psychiatric disorders represent a great medical and social challenge and people suffering from these conditions face many impairments regarding personal and professional life. In addition, a mental disorder will manifest itself in approximately one quarter of the world's population at some period of their life. Dysfun...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章,评审
doi:10.3389/fnins.2017.00493
更新日期:2017-09-07 00:00:00
abstract::Developments of new strategies to restore vision and improving on current strategies by harnessing new advancements in material and electrical sciences, and biological and genetic-based technologies are of upmost health priorities around the world. Federal and private entities are spending billions of dollars on visua...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章,评审
doi:10.3389/fnins.2020.00036
更新日期:2020-02-18 00:00:00
abstract::Corticotropin-releasing factor (CRF) is a 41-amino acid neuropeptide that is involved in stress-related physiology and behavior, including control of the hypothalamic-pituitary-adrenal (HPA) axis. Members of the CRF family of neuropeptides, including urocortin 1 (UCN 1), UCN 2, and UCN 3, bind to the G protein-coupled...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章,评审
doi:10.3389/fnins.2013.00169
更新日期:2013-09-20 00:00:00
abstract::Perinatal exposure to endocrine disrupting chemicals (EDCs) can induce promiscuous neurobehavioral disturbances. Bisphenol A and phthalates are two widely prevalent and persistent EDCs reported to lead to such effects. Parental and social behaviors are especially vulnerable to endocrine disruption, as these traits are...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章,评审
doi:10.3389/fnins.2015.00057
更新日期:2015-03-03 00:00:00
abstract::In functional magnetic resonance imaging (fMRI), functional connectivity is conventionally characterized by correlations between fMRI time series, which are intrinsically undirected measures of connectivity. Yet, some information about the directionality of network connections can nevertheless be extracted from the ma...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2018.00287
更新日期:2018-05-08 00:00:00
abstract::The mammalian brain is characterized by orderly spatial distribution of its cellular components, commonly referred to as topographical organization. The topography of cortical and subcortical maps is thought to represent functional or computational properties. In the present investigation, we have studied map transfor...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/neuro.01.1.1.016.2007
更新日期:2007-10-15 00:00:00
abstract::Currently the integrity of brain function that drives behavior is predominantly measured in terms of pure motor function, yet most human behavior is visually driven. A means of easily quantifying such visually-driven brain function for comparison against population norms is lacking. Analysis of eye-hand coordination (...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2019.00711
更新日期:2019-07-10 00:00:00
abstract::The melanin-concentrating hormone (MCH) system is a robust integrator of exogenous and endogenous information, modulating arousal and energy balance in mammals. Its predominant function in teleosts, however, is to concentrate melanin in the scales, contributing to the adaptive color change observed in several teleost ...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章,评审
doi:10.3389/fnins.2019.01280
更新日期:2019-11-26 00:00:00
abstract:Introduction:Our hands, with their exquisite sensors, work in concert with our sensing brain to extract sensory attributes of objects as we engage in daily activities. One in two people with stroke experience impaired body sensation, with negative impact on hand use and return to previous valued activities. Valid, quan...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2020.542590
更新日期:2020-09-23 00:00:00
abstract::Previous works exploring the challenges of ensuring information security for neuroprosthetic devices and their users have typically built on the traditional InfoSec concept of the "CIA Triad" of confidentiality, integrity, and availability. However, we argue that the CIA Triad provides an increasingly inadequate found...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章
doi:10.3389/fnins.2017.00605
更新日期:2017-11-07 00:00:00
abstract::Lactate is a versatile metabolite with important roles in modulation of brain glucose utilization rate (CMRglc), diagnosis of brain-injured patients, redox- and receptor-mediated signaling, memory, and alteration of gene transcription. Neurons and astrocytes release and accumulate lactate using equilibrative monocarbo...
journal_title:Frontiers in neuroscience
pub_type: 杂志文章,评审
doi:10.3389/fnins.2014.00261
更新日期:2014-09-09 00:00:00