Abstract：
:Memory models that store new memories by forgetting old ones have memory lifetimes that are rather short and grow only logarithmically in the number of synapses. Attempts to overcome these deficits include "complex" models of synaptic plasticity in which synapses possess internal states governing the expression of synaptic plasticity. Integrate-and-express, filter-based models of synaptic plasticity propose that synapses act as low-pass filters, integrating plasticity induction signals before expressing synaptic plasticity. Such mechanisms enhance memory lifetimes, leading to an initial rise in the memory signal that is in radical contrast to other related, but nonintegrative, memory models. Because of the complexity of models with internal synaptic states, however, their dynamics can be more difficult to extract compared to "simple" models that lack internal states. Here, we show that by focusing only on processes that lead to changes in synaptic strength, we can integrate out internal synaptic states and effectively reduce complex synapses to simple synapses. For binary-strength synapses, these simplified dynamics then allow us to work directly in the transitions in perceptron activation induced by memory storage rather than in the underlying transitions in synaptic configurations. This permits us to write down master and Fokker-Planck equations that may be simplified under certain, well-defined approximations. These methods allow us to see that memory based on synaptic filters can be viewed as an initial transient that leads to memory signal rise, followed by the emergence of Ornstein-Uhlenbeck-like dynamics that return the system to equilibrium. We may use this approach to compute mean first passage time-defined memory lifetimes for complex models of memory storage.
journal_name
Neural Computjournal_title
Neural computationauthors
Elliott Tdoi
10.1162/NECO_a_00956subject
Has Abstractpub_date
2017-06-01 00:00:00pages
1468-1527issue
6eissn
0899-7667issn
1530-888Xjournal_volume
29pub_type
杂志文章abstract：:A neuronal population is a computational unit that receives a multivariate, time-varying input signal and creates a related multivariate output. These neural signals are modeled as stochastic processes that transmit information in real time, subject to stochastic noise. In a stationary environment, where the input sig...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco_a_01057
更新日期：2018-04-01 00:00:00
abstract：:Disparity tuning of visual cells in the brain depends on the structure of their binocular receptive fields (RFs). Freeman and coworkers have found that binocular RFs of a typical simple cell can be quantitatively described by two Gabor functions with the same gaussian envelope but different phase parameters in the sin...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco.1996.8.8.1611
更新日期：1996-11-15 00:00:00
abstract：:This letter proposes a multichannel source separation technique, the multichannel variational autoencoder (MVAE) method, which uses a conditional VAE (CVAE) to model and estimate the power spectrograms of the sources in a mixture. By training the CVAE using the spectrograms of training examples with source-class label...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco_a_01217
更新日期：2019-09-01 00:00:00
abstract：:Intracortical brain computer interfaces can enable individuals with paralysis to control external devices through voluntarily modulated brain activity. Decoding quality has been previously shown to degrade with signal nonstationarities-specifically, the changes in the statistics of the data between training and testin...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco_a_01129
更新日期：2018-11-01 00:00:00
abstract：:A key problem in computational neuroscience is to find simple, tractable models that are nevertheless flexible enough to capture the response properties of real neurons. Here we examine the capabilities of recurrent point process models known as Poisson generalized linear models (GLMs). These models are defined by a s...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco_a_01021
更新日期：2017-12-01 00:00:00
abstract：:In learning theory, the training and test sets are assumed to be drawn from the same probability distribution. This assumption is also followed in practical situations, where matching the training and test distributions is considered desirable. Contrary to conventional wisdom, we show that mismatched training and test...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00697
更新日期：2015-02-01 00:00:00
abstract：:Regression aims at estimating the conditional mean of output given input. However, regression is not informative enough if the conditional density is multimodal, heteroskedastic, and asymmetric. In such a case, estimating the conditional density itself is preferable, but conditional density estimation (CDE) is challen...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00683
更新日期：2015-01-01 00:00:00
abstract：:The ability to encode and transmit a signal is an essential property that must demonstrate many neuronal circuits in sensory areas in addition to any processing they may provide. It is known that an appropriate level of lateral inhibition, as observed in these areas, can significantly improve the encoding ability of a...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00100
更新日期：2011-04-01 00:00:00
abstract：:This review examines the relevance of parameter identifiability for statistical models used in machine learning. In addition to defining main concepts, we address several issues of identifiability closely related to machine learning, showing the advantages and disadvantages of state-of-the-art research and demonstrati...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00947
更新日期：2017-05-01 00:00:00
abstract：:For the paradigmatic case of bimanual coordination, we review levels of organization of behavioral dynamics and present a description in terms of modes of behavior. We briefly review a recently developed model of spatiotemporal brain activity that is based on short- and long-range connectivity of neural ensembles. Thi...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976698300016954
更新日期：1998-11-15 00:00:00
abstract：:Tangential neurons in the fly brain are sensitive to the typical optic flow patterns generated during egomotion. In this study, we examine whether a simplified linear model based on the organization principles in tangential neurons can be used to estimate egomotion from the optic flow. We present a theory for the cons...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/0899766041941899
更新日期：2004-11-01 00:00:00
abstract：:Real classification problems involve structured data that can be essentially grouped into a relatively small number of clusters. It is shown that, under a local clustering condition, a set of points of a given class, embedded in binary space by a set of randomly parameterized surfaces, is linearly separable from other...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976601753196012
更新日期：2001-11-01 00:00:00
abstract：:In this letter, we propose a noisy nonlinear version of independent component analysis (ICA). Assuming that the probability density function (p. d. f.) of sources is known, a learning rule is derived based on maximum likelihood estimation (MLE). Our model involves some algorithms of noisy linear ICA (e. g., Bermond & ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/0899766052530866
更新日期：2005-01-01 00:00:00
abstract：:A variant of spiking neural P systems with positive or negative weights on synapses is introduced, where the rules of a neuron fire when the potential of that neuron equals a given value. The involved values-weights, firing thresholds, potential consumed by each rule-can be real (computable) numbers, rational numbers,...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00022
更新日期：2010-10-01 00:00:00
abstract：:Independent component analysis (ICA) aims at separating a multivariate signal into independent nongaussian signals by optimizing a contrast function with no knowledge on the mixing mechanism. Despite the availability of a constellation of contrast functions, a Hartley-entropy-based ICA contrast endowed with the discri...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00700
更新日期：2015-03-01 00:00:00
abstract：:Firing rates and synchronous firing are often simultaneously relevant signals, and they independently or cooperatively represent external sensory inputs, cognitive events, and environmental situations such as body position. However, how rates and synchrony comodulate and which aspects of inputs are effectively encoded...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976606774841521
更新日期：2006-01-01 00:00:00
abstract：:Many different types of integrate-and-fire models have been designed in order to explain how it is possible for a cortical neuron to integrate over many independent inputs while still producing highly variable spike trains. Within this context, the variability of spike trains has been almost exclusively measured using...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/0899766041732413
更新日期：2004-10-01 00:00:00
abstract：:Energy-efficient information transmission may be relevant to biological sensory signal processing as well as to low-power electronic devices. We explore its consequences in two different regimes. In an "immediate" regime, we argue that the information rate should be maximized subject to a power constraint, and in an "...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976601300014358
更新日期：2001-04-01 00:00:00
abstract：:A stochastic model of spike-timing-dependent plasticity (STDP) postulates that single synapses presented with a single spike pair exhibit all-or-none quantal jumps in synaptic strength. The amplitudes of the jumps are independent of spiking timing, but their probabilities do depend on spiking timing. By making the amp...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco.2009.07-08-814
更新日期：2010-01-01 00:00:00
abstract：:It has been suggested that reactivation of previously acquired experiences or stored information in declarative memories in the hippocampus and neocortex contributes to memory consolidation and learning. Understanding memory consolidation depends crucially on the development of robust statistical methods for assessing...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco_a_01090
更新日期：2018-08-01 00:00:00
abstract：:Cortical neurons of behaving animals generate irregular spike sequences. Recently, there has been a heated discussion about the origin of this irregularity. Softky and Koch (1993) pointed out the inability of standard single-neuron models to reproduce the irregularity of the observed spike sequences when the model par...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976699300016511
更新日期：1999-05-15 00:00:00
abstract：:Observable operator models (OOMs) are a class of models for stochastic processes that properly subsumes the class that can be modeled by finite-dimensional hidden Markov models (HMMs). One of the main advantages of OOMs over HMMs is that they admit asymptotically correct learning algorithms. A series of learning algor...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco.2009.10-08-878
更新日期：2009-12-01 00:00:00
abstract：:We have created a network that allocates a new computational unit whenever an unusual pattern is presented to the network. This network forms compact representations, yet learns easily and rapidly. The network can be used at any time in the learning process and the learning patterns do not have to be repeated. The uni...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco.1991.3.2.213
更新日期：1991-07-01 00:00:00
abstract：:Humans learn categories of complex objects quickly and from a few examples. Random projection has been suggested as a means to learn and categorize efficiently. We investigate how random projection affects categorization by humans and by very simple neural networks on the same stimuli and categorization tasks, and how...
journal_title：Neural computation
pub_type： 信件
doi：10.1162/NECO_a_00769
更新日期：2015-10-01 00:00:00
abstract：:Based on the dopamine hypotheses of cocaine addiction and the assumption of decrement of brain reward system sensitivity after long-term drug exposure, we propose a computational model for cocaine addiction. Utilizing average reward temporal difference reinforcement learning, we incorporate the elevation of basal rewa...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco.2009.10-08-882
更新日期：2009-10-01 00:00:00
abstract：:Neurons perform computations, and convey the results of those computations through the statistical structure of their output spike trains. Here we present a practical method, grounded in the information-theoretic analysis of prediction, for inferring a minimal representation of that structure and for characterizing it...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco.2009.12-07-678
更新日期：2010-01-01 00:00:00
abstract：:Decision trees and neural networks are widely used tools for pattern classification. Decision trees provide highly localized representation, whereas neural networks provide a distributed but compact representation of the decision space. Decision trees cannot be induced in the online mode, and they are not adaptive to ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/0899766041336396
更新日期：2004-09-01 00:00:00
abstract：:We study the effect of competition between short-term synaptic depression and facilitation on the dynamic properties of attractor neural networks, using Monte Carlo simulation and a mean-field analysis. Depending on the balance of depression, facilitation, and the underlying noise, the network displays different behav...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco.2007.19.10.2739
更新日期：2007-10-01 00:00:00
abstract：:A minimal model is presented to explain changes in frequency, shape, and amplitude of Ca2+ oscillations in the neuroendocrine melanotrope cell of Xenopus Laevis. It describes the cell as a plasma membrane oscillator with influx of extracellular Ca2+ via voltage-gated Ca2+ channels in the plasma membrane. The Ca2+ osci...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976601300014655
更新日期：2001-01-01 00:00:00
abstract：:We perform a detailed fixed-point analysis of two-unit recurrent neural networks with sigmoid-shaped transfer functions. Using geometrical arguments in the space of transfer function derivatives, we partition the network state-space into distinct regions corresponding to stability types of the fixed points. Unlike in ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/08997660152002898
更新日期：2001-06-01 00:00:00
