Analyzing and Accelerating the Bottlenecks of Training Deep SNNs With Backpropagation.

abstract：:Activities of sensory-specific cortices are known to be suppressed when presented with a different sensory modality stimulus. This is referred to as cross-modal inhibition, for which the conventional synaptic mechanism is unlikely to work. Interestingly, the cross-modal inhibition could be eliminated when presented wi...

journal_title：Neural computation

authors： Hoshino O

更新日期：2012-11-01 00:00:00

abstract：:The goal of sufficient dimension reduction in supervised learning is to find the low-dimensional subspace of input features that contains all of the information about the output values that the input features possess. In this letter, we propose a novel sufficient dimension-reduction method using a squared-loss variant...

journal_title：Neural computation

authors： Suzuki T,Sugiyama M

更新日期：2013-03-01 00:00:00

abstract：:We develop theoretical foundations of resonator networks, a new type of recurrent neural network introduced in Frady, Kent, Olshausen, and Sommer (2020), a companion article in this issue, to solve a high-dimensional vector factorization problem arising in Vector Symbolic Architectures. Given a composite vector formed...

journal_title：Neural computation

authors： Kent SJ,Frady EP,Sommer FT,Olshausen BA

更新日期：2020-12-01 00:00:00

abstract：:We extend the neural Turing machine (NTM) model into a dynamic neural Turing machine (D-NTM) by introducing trainable address vectors. This addressing scheme maintains for each memory cell two separate vectors, content and address vectors. This allows the D-NTM to learn a wide variety of location-based addressing stra...

journal_title：Neural computation

authors： Gulcehre C,Chandar S,Cho K,Bengio Y

更新日期：2018-04-01 00:00:00

abstract：:We study the expressive power of positive neural networks. The model uses positive connection weights and multiple input neurons. Different behaviors can be expressed by varying the connection weights. We show that in discrete time and in the absence of noise, the class of positive neural networks captures the so-call...

journal_title：Neural computation

authors： Ameloot TJ,Van den Bussche J

更新日期：2015-12-01 00:00:00

abstract：:Multiple adjacent, roughly mirror-image topographic maps are commonly observed in the sensory neocortex of many species. The cortical regions occupied by these maps are generally believed to be determined initially by genetically controlled chemical markers during development, with thalamocortical afferent activity su...

journal_title：Neural computation

authors： Schulz R,Reggia JA

更新日期：2005-05-01 00:00:00

abstract：:This article addresses the topic of extracting logical rules from data by means of artificial neural networks. The approach based on piecewise linear neural networks is revisited, which has already been used for the extraction of Boolean rules in the past, and it is shown that this approach can be important also for t...

journal_title：Neural computation

authors： Holena M

更新日期：2006-11-01 00:00:00

abstract：:This article reviews statistical techniques for combining multiple probability distributions. The framework is that of a decision maker who consults several experts regarding some events. The experts express their opinions in the form of probability distributions. The decision maker must aggregate the experts' distrib...

journal_title：Neural computation

authors： Jacobs RA

更新日期：1995-09-01 00:00:00

abstract：:We present a model of visual computation based on tightly inter-connected cliques of pyramidal cells. It leads to a formal theory of cell assemblies, a specific relationship between correlated firing patterns and abstract functionality, and a direct calculation relating estimates of cortical cell counts to orientation...

journal_title：Neural computation

authors： Miller DA,Zucker SW

更新日期：1999-01-01 00:00:00

abstract：:As neural activity is transmitted through the nervous system, neuronal noise degrades the encoded information and limits performance. It is therefore important to know how information loss can be prevented. We study this question in the context of neural population codes. Using Fisher information, we show how informat...

journal_title：Neural computation

authors： Renart A,van Rossum MC

更新日期：2012-02-01 00:00:00

abstract：:Previous work on analog VLSI implementation of multilayer perceptrons with on-chip learning has mainly targeted the implementation of algorithms like backpropagation. Although backpropagation is efficient, its implementation in analog VLSI requires excessive computational hardware. In this paper we show that, for anal...

journal_title：Neural computation

authors： Jabri M,Flower B

更新日期：1991-01-01 00:00:00

abstract：:We develop several kernel methods for classification of longitudinal data and apply them to detect cognitive decline in the elderly. We first develop mixed-effects models, a type of hierarchical empirical Bayes generative models, for the time series. After demonstrating their utility in likelihood ratio classifiers (a...

journal_title：Neural computation

authors： Lu Z,Leen TK,Kaye J

更新日期：2011-09-01 00:00:00

abstract：:The instantaneous phase of neural rhythms is important to many neuroscience-related studies. In this letter, we show that the statistical sampling properties of three instantaneous phase estimators commonly employed to analyze neuroscience data share common features, allowing an analytical investigation into their beh...

journal_title：Neural computation

authors： Lepage KQ,Kramer MA,Eden UT

更新日期：2013-04-01 00:00:00

abstract：:Decision trees and neural networks are widely used tools for pattern classification. Decision trees provide highly localized representation, whereas neural networks provide a distributed but compact representation of the decision space. Decision trees cannot be induced in the online mode, and they are not adaptive to ...

journal_title：Neural computation

authors： Basak J

更新日期：2004-09-01 00:00:00

abstract：:We study a model of the cortical macrocolumn consisting of a collection of inhibitorily coupled minicolumns. The proposed system overcomes several severe deficits of systems based on single neurons as cerebral functional units, notably limited robustness to damage and unrealistically large computation time. Motivated ...

journal_title：Neural computation

authors： Lücke J,von der Malsburg C

更新日期：2004-03-01 00:00:00

abstract：:Previous studies have combined analytical models of stochastic neural responses with signal detection theory (SDT) to predict psychophysical performance limits; however, these studies have typically been limited to simple models and simple psychophysical tasks. A companion article in this issue ("Evaluating Auditory P...

journal_title：Neural computation

authors： Heinz MG,Colburn HS,Carney LH

更新日期：2001-10-01 00:00:00

abstract：:Spiking neural P systems (SN P systems) are a class of distributed parallel computing devices inspired by spiking neurons, where the spiking rules are usually used in a sequential way (an applicable rule is applied one time at a step) or an exhaustive way (an applicable rule is applied as many times as possible at a s...

journal_title：Neural computation

authors： Zhang X,Wang B,Pan L

更新日期：2014-12-01 00:00:00

abstract：:Reservoir computing is a biologically inspired class of learning algorithms in which the intrinsic dynamics of a recurrent neural network are mined to produce target time series. Most existing reservoir computing algorithms rely on fully supervised learning rules, which require access to an exact copy of the target re...

journal_title：Neural computation

authors： Pyle R,Rosenbaum R

更新日期：2019-07-01 00:00:00

abstract：:A simple associationist neural network learns to factor abstract rules (i.e., grammars) from sequences of arbitrary input symbols by inventing abstract representations that accommodate unseen symbol sets as well as unseen but similar grammars. The neural network is shown to have the ability to transfer grammatical kno...

journal_title：Neural computation

authors： Hanson SJ,Negishi M

更新日期：2002-09-01 00:00:00

abstract：:We study the learning of an external signal by a neural network and the time to forget it when this network is submitted to noise. The presentation of an external stimulus to the recurrent network of binary neurons may change the state of the synapses. Multiple presentations of a unique signal lead to its learning. Th...

journal_title：Neural computation

authors： Helson P

更新日期：2020-07-01 00:00:00

abstract：:The Kalman filter provides a simple and efficient algorithm to compute the posterior distribution for state-space models where both the latent state and measurement models are linear and gaussian. Extensions to the Kalman filter, including the extended and unscented Kalman filters, incorporate linearizations for model...

journal_title：Neural computation

authors： Burkhart MC,Brandman DM,Franco B,Hochberg LR,Harrison MT

更新日期：2020-05-01 00:00:00

abstract：:Many neurons that initially respond to a stimulus stop responding if the stimulus is presented repeatedly but recover their response if a different stimulus is presented. This phenomenon is referred to as stimulus-specific adaptation (SSA). SSA has been investigated extensively using oddball experiments, which measure...

journal_title：Neural computation

authors： Mill R,Coath M,Wennekers T,Denham SL

更新日期：2011-02-01 00:00:00

abstract：:We analyze convergence of the expectation maximization (EM) and variational Bayes EM (VBEM) schemes for parameter estimation in noisy linear models. The analysis shows that both schemes are inefficient in the low-noise limit. The linear model with additive noise includes as special cases independent component analysis...

journal_title：Neural computation

authors： Petersen KB,Winther O,Hansen LK

更新日期：2005-09-01 00:00:00

abstract：:How do multiple feature maps that coexist in the same region of cerebral cortex align with each other? We hypothesize that such alignment is governed by temporal correlations: features in one map that are temporally correlated with those in another come to occupy the same spatial locations in cortex over time. To exam...

journal_title：Neural computation

authors： Chen Y,Reggia JA

更新日期：1996-05-15 00:00:00

abstract：:We investigate the approximation ability of a multilayer perceptron (MLP) network when it is extended to the complex domain. The main challenge for processing complex data with neural networks has been the lack of bounded and analytic complex nonlinear activation functions in the complex domain, as stated by Liouville...

journal_title：Neural computation

authors： Kim T,Adali T

更新日期：2003-07-01 00:00:00

abstract：:Large-scale data collection efforts to map the brain are underway at multiple spatial and temporal scales, but all face fundamental problems posed by high-dimensional data and intersubject variability. Even seemingly simple problems, such as identifying a neuron/brain region across animals/subjects, become exponential...

journal_title：Neural computation

authors： Frady EP,Kapoor A,Horvitz E,Kristan WB Jr

更新日期：2016-08-01 00:00:00

abstract：:The pyloric network of the stomatogastric ganglion in crustacea is a central pattern generator that can produce the same basic rhythm over a wide frequency range. Three electrically coupled neurons, the anterior burster (AB) neuron and two pyloric dilator (PD) neurons, act as a pacemaker unit for the pyloric network. ...

journal_title：Neural computation

authors： Abbott LF,Marder E,Hooper SL

更新日期：1991-01-01 00:00:00

abstract：:The new time-organized map (TOM) is presented for a better understanding of the self-organization and geometric structure of cortical signal representations. The algorithm extends the common self-organizing map (SOM) from the processing of purely spatial signals to the processing of spatiotemporal signals. The main ad...

journal_title：Neural computation

authors： Wiemer JC

更新日期：2003-05-01 00:00:00

abstract：:In this work, we study how the selection of examples affects the learning procedure in a boolean neural network and its relationship with the complexity of the function under study and its architecture. We analyze the generalization capacity for different target functions with particular architectures through an analy...

journal_title：Neural computation

authors： Franco L,Cannas SA

更新日期：2000-10-01 00:00:00

abstract：:We investigated a model for the neural integrator based on hysteretic units connected by positive feedback. Hysteresis is assumed to emerge from the intrinsic properties of the cells. We consider the recurrent networks containing either bistable or multistable neurons. We apply our analysis to the oculomotor velocity-...

journal_title：Neural computation

authors： Nikitchenko M,Koulakov A

更新日期：2008-10-01 00:00:00