Neural Quadratic Discriminant Analysis: Nonlinear Decoding with V1-Like Computation.

abstract：:We explicitly analyze the trajectories of learning near singularities in hierarchical networks, such as multilayer perceptrons and radial basis function networks, which include permutation symmetry of hidden nodes, and show their general properties. Such symmetry induces singularities in their parameter space, where t...

journal_title：Neural computation

authors： Wei H,Zhang J,Cousseau F,Ozeki T,Amari S

更新日期：2008-03-01 00:00:00

abstract：:For gradient descent learning to yield connectivity consistent with real biological networks, the simulated neurons would have to include more realistic intrinsic properties such as frequency adaptation. However, gradient descent learning cannot be used straightforwardly with adapting rate-model neurons because the de...

journal_title：Neural computation

authors： Fortier PA,Guigon E,Burnod Y

更新日期：2005-09-01 00:00:00

abstract：:Theories of learning and generalization hold that the generalization bias, defined as the difference between the training error and the generalization error, increases on average with the number of adaptive parameters. This article, however, shows that this general tendency is violated for a gaussian mixture model. Fo...

journal_title：Neural computation

authors： Akaho S,Kappen HJ

更新日期：2000-06-01 00:00:00

abstract：:We argue that when faced with big data sets, learning and inference algorithms should compute updates using only subsets of data items. We introduce algorithms that use sequential hypothesis tests to adaptively select such a subset of data points. The statistical properties of this subsampling process can be used to c...

journal_title：Neural computation

authors： Korattikara A,Chen Y,Welling M

更新日期：2016-01-01 00:00:00

abstract：:Neuromorphic engineering combines the architectural and computational principles of systems neuroscience with semiconductor electronics, with the aim of building efficient and compact devices that mimic the synaptic and neural machinery of the brain. The energy consumptions promised by neuromorphic engineering are ext...

journal_title：Neural computation

authors： Martí D,Rigotti M,Seok M,Fusi S

更新日期：2016-10-01 00:00:00

abstract：:Due to many experimental reports of synchronous neural activity in the brain, there is much interest in understanding synchronization in networks of neural oscillators and its potential for computing perceptual organization. Contrary to Hopfield and Herz (1995), we find that networks of locally coupled integrate-and-f...

journal_title：Neural computation

authors： Campbell SR,Wang DL,Jayaprakash C

更新日期：1999-10-01 00:00:00

abstract：:We propose a new principle for replicating receptive field properties of neurons in the primary visual cortex. We derive a learning rule for a feedforward network, which maintains a low firing rate for the output neurons (resulting in temporal sparseness) and allows only a small subset of the neurons in the network to...

journal_title：Neural computation

authors： Tanaka T,Aoyagi T,Kaneko T

更新日期：2012-10-01 00:00:00

abstract：:We perform a detailed fixed-point analysis of two-unit recurrent neural networks with sigmoid-shaped transfer functions. Using geometrical arguments in the space of transfer function derivatives, we partition the network state-space into distinct regions corresponding to stability types of the fixed points. Unlike in ...

journal_title：Neural computation

authors： Tino P,Horne BG,Giles CL

更新日期：2001-06-01 00:00:00

abstract：:Cortical neurons of behaving animals generate irregular spike sequences. Recently, there has been a heated discussion about the origin of this irregularity. Softky and Koch (1993) pointed out the inability of standard single-neuron models to reproduce the irregularity of the observed spike sequences when the model par...

journal_title：Neural computation

authors： Shinomoto S,Sakai Y,Funahashi S

更新日期：1999-05-15 00:00:00

abstract：:We consider the problem of training a linear feedforward neural network by using a gradient descent-like LMS learning algorithm. The objective is to find a weight matrix for the network, by repeatedly presenting to it a finite set of examples, so that the sum of the squares of the errors is minimized. Kohonen showed t...

journal_title：Neural computation

authors： Luo ZQ

更新日期：1991-07-01 00:00:00

abstract：:We study the learning of an external signal by a neural network and the time to forget it when this network is submitted to noise. The presentation of an external stimulus to the recurrent network of binary neurons may change the state of the synapses. Multiple presentations of a unique signal lead to its learning. Th...

journal_title：Neural computation

authors： Helson P

更新日期：2020-07-01 00:00:00

abstract：:We considered a gamma distribution of interspike intervals as a statistical model for neuronal spike generation. A gamma distribution is a natural extension of the Poisson process taking the effect of a refractory period into account. The model is specified by two parameters: a time-dependent firing rate and a shape p...

journal_title：Neural computation

authors： Miura K,Okada M,Amari S

更新日期：2006-10-01 00:00:00

abstract：:This letter deals with neural networks as dynamical systems governed by finite difference equations. It shows that the introduction of k -many skip connections into network architectures, such as residual networks and additive dense n...

journal_title：Neural computation

authors： Hauser M,Gunn S,Saab S Jr,Ray A

更新日期：2019-03-01 00:00:00

abstract：:Most conventional policy gradient reinforcement learning (PGRL) algorithms neglect (or do not explicitly make use of) a term in the average reward gradient with respect to the policy parameter. That term involves the derivative of the stationary state distribution that corresponds to the sensitivity of its distributio...

journal_title：Neural computation

authors： Morimura T,Uchibe E,Yoshimoto J,Peters J,Doya K

更新日期：2010-02-01 00:00:00

abstract：:The statistical dependencies that independent component analysis (ICA) cannot remove often provide rich information beyond the linear independent components. It would thus be very useful to estimate the dependency structure from data. While such models have been proposed, they have usually concentrated on higher-order...

journal_title：Neural computation

authors： Sasaki H,Gutmann MU,Shouno H,Hyvärinen A

更新日期：2017-11-01 00:00:00

abstract：:Although the commonly used quadratic Hebbian-anti-Hebbian rules lead to successful models of plasticity and learning, they are inconsistent with neurophysiology. Other rules, more physiologically plausible, fail to specify the biological mechanism of bidirectionality and the biological mechanism that prevents synapses...

journal_title：Neural computation

authors： Grzywacz NM,Burgi PY

更新日期：1998-04-01 00:00:00

abstract：:Knowledge of synaptic input is crucial for understanding synaptic integration and ultimately neural function. However, in vivo, the rates at which synaptic inputs arrive are high, so that it is typically impossible to detect single events. We show here that it is nevertheless possible to extract the properties of the ...

journal_title：Neural computation

authors： Puggioni P,Jelitai M,Duguid I,van Rossum MCW

更新日期：2017-07-01 00:00:00

abstract：:Control in the natural environment is difficult in part because of uncertainty in the effect of actions. Uncertainty can be due to added motor or sensory noise, unmodeled dynamics, or quantization of sensory feedback. Biological systems are faced with further difficulties, since control must be performed by networks o...

journal_title：Neural computation

authors： Sanger TD

更新日期：2011-08-01 00:00:00

abstract：:The prevalence of coherent oscillations in various frequency ranges in the central nervous system raises the question of the mechanisms that synchronize large populations of neurons. We study synchronization in models of large networks of spiking neurons with random sparse connectivity. Synchrony occurs only when the ...

journal_title：Neural computation

authors： Golomb D,Hansel D

更新日期：2000-05-01 00:00:00

abstract：:In this letter, we investigate the fundamental limits on how the interspike time of a neuron oscillator can be perturbed by the application of a bounded external control input (a current stimulus) with zero net electric charge accumulation. We use phase models to study the dynamics of neurons and derive charge-balance...

journal_title：Neural computation

authors： Dasanayake IS,Li JS

更新日期：2014-10-01 00:00:00

abstract：:Decision trees and neural networks are widely used tools for pattern classification. Decision trees provide highly localized representation, whereas neural networks provide a distributed but compact representation of the decision space. Decision trees cannot be induced in the online mode, and they are not adaptive to ...

journal_title：Neural computation

authors： Basak J

更新日期：2004-09-01 00:00:00

abstract：:Topographic maps such as the self-organizing map (SOM) or neural gas (NG) constitute powerful data mining techniques that allow simultaneously clustering data and inferring their topological structure, such that additional features, for example, browsing, become available. Both methods have been introduced for vectori...

journal_title：Neural computation

authors： Hammer B,Hasenfuss A

更新日期：2010-09-01 00:00:00

abstract：:The goal of sufficient dimension reduction in supervised learning is to find the low-dimensional subspace of input features that contains all of the information about the output values that the input features possess. In this letter, we propose a novel sufficient dimension-reduction method using a squared-loss variant...

journal_title：Neural computation

authors： Suzuki T,Sugiyama M

更新日期：2013-03-01 00:00:00

abstract：:We simulate the inhibition of Ia-glutamatergic excitatory postsynaptic potential (EPSP) by preceding it with glycinergic recurrent (REN) and reciprocal (REC) inhibitory postsynaptic potentials (IPSPs). The inhibition is evaluated in the presence of voltage-dependent conductances of sodium, delayed rectifier potassium,...

journal_title：Neural computation

authors： Gradwohl G,Grossman Y

更新日期：2013-01-01 00:00:00

abstract：:Mechanisms influencing learning in neural networks are usually investigated on either a local or a global scale. The former relates to synaptic processes, the latter to unspecific modulatory systems. Here we study the interaction of a local learning rule that evaluates coincidences of pre- and postsynaptic action pote...

journal_title：Neural computation

authors： Sánchez-Montañés MA,Verschure PF,König P

更新日期：2000-03-01 00:00:00

abstract：:Many neurons that initially respond to a stimulus stop responding if the stimulus is presented repeatedly but recover their response if a different stimulus is presented. This phenomenon is referred to as stimulus-specific adaptation (SSA). SSA has been investigated extensively using oddball experiments, which measure...

journal_title：Neural computation

authors： Mill R,Coath M,Wennekers T,Denham SL

更新日期：2011-02-01 00:00:00

abstract：:This article presents a reinforcement learning framework for continuous-time dynamical systems without a priori discretization of time, state, and action. Based on the Hamilton-Jacobi-Bellman (HJB) equation for infinite-horizon, discounted reward problems, we derive algorithms for estimating value functions and improv...

journal_title：Neural computation

authors： Doya K

更新日期：2000-01-01 00:00:00

abstract：:The ability to achieve high swimming speed and efficiency is very important to both the real lamprey and its robotic implementation. In previous studies, we used evolutionary algorithms to evolve biologically plausible connectionist swimming controllers for a simulated lamprey. This letter investigates the robustness ...

journal_title：Neural computation

authors： Or J

更新日期：2007-06-01 00:00:00

abstract：:GABAergic synapse reversal potential is controlled by the concentration of chloride. This concentration can change significantly during development and as a function of neuronal activity. Thus, GABA inhibition can be hyperpolarizing, shunting, or partially depolarizing. Previous results pinpointed the conditions under...

journal_title：Neural computation

authors： Jeong HY,Gutkin B

更新日期：2007-03-01 00:00:00

abstract：:We present a first-order nonhomogeneous Markov model for the interspike-interval density of a continuously stimulated spiking neuron. The model allows the conditional interspike-interval density and the stationary interspike-interval density to be expressed as products of two separate functions, one of which describes...

journal_title：Neural computation

authors： Tapson J,Jin C,van Schaik A,Etienne-Cummings R

更新日期：2009-06-01 00:00:00