Abstract：
:Uncertainty coming from the noise in its neurons and the ill-posed nature of many tasks plagues neural computations. Maybe surprisingly, many studies show that the brain manipulates these forms of uncertainty in a probabilistically consistent and normative manner, and there is now a rich theoretical literature on the capabilities of populations of neurons to implement computations in the face of uncertainty. However, one major facet of uncertainty has received comparatively little attention: time. In a dynamic, rapidly changing world, data are only temporarily relevant. Here, we analyze the computational consequences of encoding stimulus trajectories in populations of neurons. For the most obvious, simple, instantaneous encoder, the correlations induced by natural, smooth stimuli engender a decoder that requires access to information that is nonlocal both in time and across neurons. This formally amounts to a ruinous representation. We show that there is an alternative encoder that is computationally and representationally powerful in which each spike contributes independent information; it is independently decodable, in other words. We suggest this as an appropriate foundation for understanding time-varying population codes. Furthermore, we show how adaptation to temporal stimulus statistics emerges directly from the demands of simple decoding.
journal_name
Neural Computjournal_title
Neural computationauthors
Huys QJ,Zemel RS,Natarajan R,Dayan Pdoi
10.1162/neco.2007.19.2.404subject
Has Abstractpub_date
2007-02-01 00:00:00pages
404-41issue
2eissn
0899-7667issn
1530-888Xjournal_volume
19pub_type
信件abstract：:This article reviews statistical techniques for combining multiple probability distributions. The framework is that of a decision maker who consults several experts regarding some events. The experts express their opinions in the form of probability distributions. The decision maker must aggregate the experts' distrib...
journal_title：Neural computation
pub_type： 杂志文章,评审
doi：10.1162/neco.1995.7.5.867
更新日期：1995-09-01 00:00:00
abstract：:Calculation of the total conductance change induced by multiple synapses at a given membrane compartment remains one of the most time-consuming processes in biophysically realistic neural network simulations. Here we show that this calculation can be achieved in a highly efficient way even for multiply converging syna...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976698300017061
更新日期：1998-10-01 00:00:00
abstract：:Neural associative memories are perceptron-like single-layer networks with fast synaptic learning typically storing discrete associations between pairs of neural activity patterns. Previous work optimized the memory capacity for various models of synaptic learning: linear Hopfield-type rules, the Willshaw model employ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00127
更新日期：2011-06-01 00:00:00
abstract：:We derive analytically the solution for the output rate of the ideal coincidence detector. The solution is for an arbitrary number of input spike trains with identical binomial count distributions (which includes Poisson statistics as a special case) and identical arbitrary pairwise cross-correlations, from zero corre...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976603321192068
更新日期：2003-03-01 00:00:00
abstract：:We perform a detailed fixed-point analysis of two-unit recurrent neural networks with sigmoid-shaped transfer functions. Using geometrical arguments in the space of transfer function derivatives, we partition the network state-space into distinct regions corresponding to stability types of the fixed points. Unlike in ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/08997660152002898
更新日期：2001-06-01 00:00:00
abstract：:Mechanisms influencing learning in neural networks are usually investigated on either a local or a global scale. The former relates to synaptic processes, the latter to unspecific modulatory systems. Here we study the interaction of a local learning rule that evaluates coincidences of pre- and postsynaptic action pote...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976600300015682
更新日期：2000-03-01 00:00:00
abstract：:A significant threat to the recent, wide deployment of machine learning-based systems, including deep neural networks (DNNs), is adversarial learning attacks. The main focus here is on evasion attacks against DNN-based classifiers at test time. While much work has focused on devising attacks that make small perturbati...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco_a_01209
更新日期：2019-08-01 00:00:00
abstract：:In this letter, we propose a noisy nonlinear version of independent component analysis (ICA). Assuming that the probability density function (p. d. f.) of sources is known, a learning rule is derived based on maximum likelihood estimation (MLE). Our model involves some algorithms of noisy linear ICA (e. g., Bermond & ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/0899766052530866
更新日期：2005-01-01 00:00:00
abstract：:We formulate an equivalence between machine learning and the formulation of statistical data assimilation as used widely in physical and biological sciences. The correspondence is that layer number in a feedforward artificial network setting is the analog of time in the data assimilation setting. This connection has b...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco_a_01094
更新日期：2018-08-01 00:00:00
abstract：:In a biological nervous system, astrocytes play an important role in the functioning and interaction of neurons, and astrocytes have excitatory and inhibitory influence on synapses. In this work, with this biological inspiration, a class of computation devices that consist of neurons and astrocytes is introduced, call...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00238
更新日期：2012-03-01 00:00:00
abstract：:The free-energy principle is a candidate unified theory for learning and memory in the brain that predicts that neurons, synapses, and neuromodulators work in a manner that minimizes free energy. However, electrophysiological data elucidating the neural and synaptic bases for this theory are lacking. Here, we propose ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00862
更新日期：2016-09-01 00:00:00
abstract：:Integrate-and-express models of synaptic plasticity propose that synapses integrate plasticity induction signals before expressing synaptic plasticity. By discerning trends in their induction signals, synapses can control destabilizing fluctuations in synaptic strength. In a feedforward perceptron framework with binar...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00889
更新日期：2016-11-01 00:00:00
abstract：:Neuroscience is progressing vigorously, and knowledge at different levels of description is rapidly accumulating. To establish relationships between results found at these different levels is one of the central challenges. In this simulation study, we demonstrate how microscopic cellular properties, taking the example...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976699300016377
更新日期：1999-07-01 00:00:00
abstract：:We develop theoretical foundations of resonator networks, a new type of recurrent neural network introduced in Frady, Kent, Olshausen, and Sommer (2020), a companion article in this issue, to solve a high-dimensional vector factorization problem arising in Vector Symbolic Architectures. Given a composite vector formed...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco_a_01329
更新日期：2020-12-01 00:00:00
abstract：:Spiking neural networks (SNNs) with the event-driven manner of transmitting spikes consume ultra-low power on neuromorphic chips. However, training deep SNNs is still challenging compared to convolutional neural networks (CNNs). The SNN training algorithms have not achieved the same performance as CNNs. In this letter...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco_a_01319
更新日期：2020-12-01 00:00:00
abstract：:We outline a hybrid analog-digital scheme for computing with three important features that enable it to scale to systems of large complexity: First, like digital computation, which uses several one-bit precise logical units to collectively compute a precise answer to a computation, the hybrid scheme uses several moder...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976602320263971
更新日期：2002-09-01 00:00:00
abstract：:We investigate the approximation ability of a multilayer perceptron (MLP) network when it is extended to the complex domain. The main challenge for processing complex data with neural networks has been the lack of bounded and analytic complex nonlinear activation functions in the complex domain, as stated by Liouville...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976603321891846
更新日期：2003-07-01 00:00:00
abstract：:Generalized discriminant analysis (GDA) is an extension of the classical linear discriminant analysis (LDA) from linear domain to a nonlinear domain via the kernel trick. However, in the previous algorithm of GDA, the solutions may suffer from the degenerate eigenvalue problem (i.e., several eigenvectors with the same...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976604773717612
更新日期：2004-06-01 00:00:00
abstract：:This article presents new procedures for multisite spatiotemporal neuronal data analysis. A new statistical model - the diffusion model - is considered, whose parameters can be estimated from experimental data thanks to mean-field approximations. This work has been applied to optical recording of the guinea pig's audi...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976600300015150
更新日期：2000-08-01 00:00:00
abstract：:A simple associationist neural network learns to factor abstract rules (i.e., grammars) from sequences of arbitrary input symbols by inventing abstract representations that accommodate unseen symbol sets as well as unseen but similar grammars. The neural network is shown to have the ability to transfer grammatical kno...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976602320264079
更新日期：2002-09-01 00:00:00
abstract：:Control in the natural environment is difficult in part because of uncertainty in the effect of actions. Uncertainty can be due to added motor or sensory noise, unmodeled dynamics, or quantization of sensory feedback. Biological systems are faced with further difficulties, since control must be performed by networks o...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00151
更新日期：2011-08-01 00:00:00
abstract：:Inner-product operators, often referred to as kernels in statistical learning, define a mapping from some input space into a feature space. The focus of this letter is the construction of biologically motivated kernels for cortical activities. The kernels we derive, termed Spikernels, map spike count sequences into an...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/0899766053019944
更新日期：2005-03-01 00:00:00
abstract：:The hypothesis of invariant maximization of interaction (IMI) is formulated within the setting of random fields. According to this hypothesis, learning processes maximize the stochastic interaction of the neurons subject to constraints. We consider the extrinsic constraint in terms of a fixed input distribution on the...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976602760805368
更新日期：2002-12-01 00:00:00
abstract：:This review examines the relevance of parameter identifiability for statistical models used in machine learning. In addition to defining main concepts, we address several issues of identifiability closely related to machine learning, showing the advantages and disadvantages of state-of-the-art research and demonstrati...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00947
更新日期：2017-05-01 00:00:00
abstract：:In considering a statistical model selection of neural networks and radial basis functions under an overrealizable case, the problem of unidentifiability emerges. Because the model selection criterion is an unbiased estimator of the generalization error based on the training error, this article analyzes the expected t...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976602760128090
更新日期：2002-08-01 00:00:00
abstract：:The Bayesian evidence framework has been successfully applied to the design of multilayer perceptrons (MLPs) in the work of MacKay. Nevertheless, the training of MLPs suffers from drawbacks like the nonconvex optimization problem and the choice of the number of hidden units. In support vector machines (SVMs) for class...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976602753633411
更新日期：2002-05-01 00:00:00
abstract：:Theories of learning and generalization hold that the generalization bias, defined as the difference between the training error and the generalization error, increases on average with the number of adaptive parameters. This article, however, shows that this general tendency is violated for a gaussian mixture model. Fo...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976600300015439
更新日期：2000-06-01 00:00:00
abstract：:The successor representation was introduced into reinforcement learning by Dayan ( 1993 ) as a means of facilitating generalization between states with similar successors. Although reinforcement learning in general has been used extensively as a model of psychological and neural processes, the psychological validity o...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00282
更新日期：2012-06-01 00:00:00
abstract：:High-density electrocorticogram (ECoG) electrodes are capable of recording neurophysiological data with high temporal resolution with wide spatial coverage. These recordings are a window to understanding how the human brain processes information and subsequently behaves in healthy and pathologic states. Here, we descr...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco_a_01009
更新日期：2017-12-01 00:00:00
abstract：:A spiking neuron "computes" by transforming a complex dynamical input into a train of action potentials, or spikes. The computation performed by the neuron can be formulated as dimensional reduction, or feature detection, followed by a nonlinear decision function over the low-dimensional space. Generalizations of the ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/08997660360675017
更新日期：2003-08-01 00:00:00
