Long-term reward prediction in TD models of the dopamine system.

abstract：:A firing rate map, also known as a tuning curve, describes the nonlinear relationship between a neuron's spike rate and a low-dimensional stimulus (e.g., orientation, head direction, contrast, color). Here we investigate Bayesian active learning methods for estimating firing rate maps in closed-loop neurophysiology ex...

journal_title：Neural computation

authors： Park M,Weller JP,Horwitz GD,Pillow JW

更新日期：2014-08-01 00:00:00

abstract：:A general method is presented to classify temporal patterns generated by rhythmic biological networks when synaptic connections and cellular properties are known. The method is discrete in nature and relies on algebraic properties of state transitions and graph theory. Elements of the set of rhythms generated by a net...

journal_title：Neural computation

authors： Roberts PD

更新日期：1998-10-01 00:00:00

abstract：:A fast and accurate computational scheme for simulating nonlinear dynamic systems is presented. The scheme assumes that the system can be represented by a combination of components of only two different types: first-order low-pass filters and static nonlinearities. The parameters of these filters and nonlinearities ma...

journal_title：Neural computation

authors： van Hateren JH

更新日期：2008-07-01 00:00:00

abstract：:Temporal slowness is a learning principle that allows learning of invariant representations by extracting slowly varying features from quickly varying input signals. Slow feature analysis (SFA) is an efficient algorithm based on this principle and has been applied to the learning of translation, scale, and other invar...

journal_title：Neural computation

authors： Wiskott L

更新日期：2003-09-01 00:00:00

abstract：:In a previous article, we considered game trees as graphical models. Adopting an evaluation function that returned a probability distribution over values likely to be taken at a given position, we described how to build a model of uncertainty and use it for utility-directed growth of the search tree and for deciding o...

journal_title：Neural computation

authors： Baum EB,Smith WD

更新日期：1999-01-01 00:00:00

abstract：:In this letter, we examine a general method of approximation, known as the Kikuchi approximation method, for finding the marginals of a product distribution, as well as the corresponding partition function. The Kikuchi approximation method defines a certain constrained optimization problem, called the Kikuchi problem,...

journal_title：Neural computation

authors： Pakzad P,Anantharam V

更新日期：2005-08-01 00:00:00

abstract：:The dynamic formation of groups of neurons--neuronal assemblies--is believed to mediate cognitive phenomena at many levels, but their detailed operation and mechanisms of interaction are still to be uncovered. One hypothesis suggests that synchronized oscillations underpin their formation and functioning, with a focus...

journal_title：Neural computation

authors： Moioli RC,Husbands P

更新日期：2013-11-01 00:00:00

abstract：:The visual systems of many mammals, including humans, are able to integrate the geometric information of visual stimuli and perform cognitive tasks at the first stages of the cortical processing. This is thought to be the result of a combination of mechanisms, which include feature extraction at the single cell level ...

journal_title：Neural computation

authors： Cocci G,Barbieri D,Citti G,Sarti A

更新日期：2015-06-01 00:00:00

abstract：:GABAergic synapse reversal potential is controlled by the concentration of chloride. This concentration can change significantly during development and as a function of neuronal activity. Thus, GABA inhibition can be hyperpolarizing, shunting, or partially depolarizing. Previous results pinpointed the conditions under...

journal_title：Neural computation

authors： Jeong HY,Gutkin B

更新日期：2007-03-01 00:00:00

abstract：:Synchronized firings in the networks of class 1 excitable neurons with excitatory and inhibitory connections are investigated, and their dependences on the forms of interactions are analyzed. As the forms of interactions, we treat the double exponential coupling and the interactions derived from it: pulse coupling, ex...

journal_title：Neural computation

authors： Kanamaru T,Sekine M

更新日期：2005-06-01 00:00:00

abstract：:Much experimental evidence suggests that during decision making, neural circuits accumulate evidence supporting alternative options. A computational model well describing this accumulation for choices between two options assumes that the brain integrates the log ratios of the likelihoods of the sensory inputs given th...

journal_title：Neural computation

authors： Kurzawa N,Summerfield C,Bogacz R

更新日期：2017-02-01 00:00:00

abstract：:We propose that replication (with mutation) of patterns of neuronal activity can occur within the brain using known neurophysiological processes. Thereby evolutionary algorithms implemented by neuro- nal circuits can play a role in cognition. Replication of structured neuronal representations is assumed in several cog...

journal_title：Neural computation

authors： Fernando C,Goldstein R,Szathmáry E

更新日期：2010-11-01 00:00:00

abstract：:A study of a general central pattern generator (CPG) is carried out by means of a measure of the gain of information between the number of available topology configurations and the output rhythmic activity. The neurons of the CPG are chaotic Hindmarsh-Rose models that cooperate dynamically to generate either chaotic o...

journal_title：Neural computation

authors： Stiesberg GR,Reyes MB,Varona P,Pinto RD,Huerta R

更新日期：2007-04-01 00:00:00

abstract：:We perform a detailed fixed-point analysis of two-unit recurrent neural networks with sigmoid-shaped transfer functions. Using geometrical arguments in the space of transfer function derivatives, we partition the network state-space into distinct regions corresponding to stability types of the fixed points. Unlike in ...

journal_title：Neural computation

authors： Tino P,Horne BG,Giles CL

更新日期：2001-06-01 00:00:00

abstract：:Visual navigation requires the estimation of self-motion as well as the segmentation of objects from the background. We suggest a definition of local velocity gradients to compute types of self-motion, segment objects, and compute local properties of optical flow fields, such as divergence, curl, and shear. Such veloc...

journal_title：Neural computation

authors： Raudies F,Ringbauer S,Neumann H

更新日期：2013-09-01 00:00:00

abstract：:We show that Langevin Markov chain Monte Carlo inference in an energy-based model with latent variables has the property that the early steps of inference, starting from a stationary point, correspond to propagating error gradients into internal layers, similar to backpropagation. The backpropagated error is with resp...

journal_title：Neural computation

authors： Bengio Y,Mesnard T,Fischer A,Zhang S,Wu Y

更新日期：2017-03-01 00:00:00

abstract：:Numerous animal behaviors, such as locomotion in vertebrates, are produced by rhythmic contractions that alternate between two muscle groups. The neuronal networks generating such alternate rhythmic activity are generally thought to rely on pacemaker cells or well-designed circuits consisting of inhibitory and excitat...

journal_title：Neural computation

authors： Senn W,Wannier T,Kleinle J,Lüscher HR,Müller L,Streit J,Wyler K

更新日期：1998-07-01 00:00:00

abstract：:Knowledge of synaptic input is crucial for understanding synaptic integration and ultimately neural function. However, in vivo, the rates at which synaptic inputs arrive are high, so that it is typically impossible to detect single events. We show here that it is nevertheless possible to extract the properties of the ...

journal_title：Neural computation

authors： Puggioni P,Jelitai M,Duguid I,van Rossum MCW

更新日期：2017-07-01 00:00:00

abstract：:This article presents a reinforcement learning framework for continuous-time dynamical systems without a priori discretization of time, state, and action. Based on the Hamilton-Jacobi-Bellman (HJB) equation for infinite-horizon, discounted reward problems, we derive algorithms for estimating value functions and improv...

journal_title：Neural computation

authors： Doya K

更新日期：2000-01-01 00:00:00

abstract：:Synaptic runaway denotes the formation of erroneous synapses and premature functional decline accompanying activity-dependent learning in neural networks. This work studies synaptic runaway both analytically and numerically in binary-firing associative memory networks. It turns out that synaptic runaway is of fairly m...

journal_title：Neural computation

authors： Greenstein-Messica A,Ruppin E

更新日期：1998-02-15 00:00:00

abstract：:Field models provide an elegant mathematical framework to analyze large-scale patterns of neural activity. On the microscopic level, these models are usually based on either a firing-rate picture or integrate-and-fire dynamics. This article shows that in spite of the large conceptual differences between the two types ...

journal_title：Neural computation

authors： Cremers D,Herz AV

更新日期：2002-07-01 00:00:00

abstract：:Pharmacologically isolated GABAergic irregular spiking and stuttering interneurons in the mouse visual cortex display highly irregular spike times, with high coefficients of variation approximately 0.9-3, in response to a depolarizing, constant current input. This is in marked contrast to cortical pyramidal cells, whi...

journal_title：Neural computation

authors： Englitz B,Stiefel KM,Sejnowski TJ

更新日期：2008-01-01 00:00:00

abstract：:Recently there has been great interest in sparse representations of signals under the assumption that signals (data sets) can be well approximated by a linear combination of few elements of a known basis (dictionary). Many algorithms have been developed to find such representations for one-dimensional signals (vectors...

journal_title：Neural computation

authors： Caiafa CF,Cichocki A

更新日期：2013-01-01 00:00:00

abstract：:We study the effect of competition between short-term synaptic depression and facilitation on the dynamic properties of attractor neural networks, using Monte Carlo simulation and a mean-field analysis. Depending on the balance of depression, facilitation, and the underlying noise, the network displays different behav...

journal_title：Neural computation

authors： Torres JJ,Cortes JM,Marro J,Kappen HJ

更新日期：2007-10-01 00:00:00

abstract：:Nondeclarative memory and novelty processing in the brain is an actively studied field of neuroscience, and reducing neural activity with repetition of a stimulus (repetition suppression) is a commonly observed phenomenon. Recent findings of an opposite trend-specifically, rising activity for unfamiliar stimuli-questi...

journal_title：Neural computation

authors： Makukhin K,Bolland S

更新日期：2014-04-01 00:00:00

abstract：:We have studied some of the design trade-offs governing visual representations based on spatially invariant conjunctive feature detectors, with an emphasis on the susceptibility of such systems to false-positive recognition errors-Malsburg's classical binding problem. We begin by deriving an analytical model that make...

journal_title：Neural computation

authors： Mel BW,Fiser J

更新日期：2000-04-01 00:00:00

abstract：:Recurrent neural architectures having oscillatory dynamics use rhythmic network activity to represent patterns stored in short-term memory. Multiple stored patterns can be retained in memory over the same neural substrate because the network's state persistently switches between them. Here we present a simple oscillat...

journal_title：Neural computation

authors： Winder RK,Reggia JA,Weems SA,Bunting MF

更新日期：2009-03-01 00:00:00

abstract：:In this letter, we develop a gaussian process model for clustering. The variances of predictive values in gaussian processes learned from a training data are shown to comprise an estimate of the support of a probability density function. The constructed variance function is then applied to construct a set of contours ...

journal_title：Neural computation

authors： Kim HC,Lee J

更新日期：2007-11-01 00:00:00

abstract：:A key problem in computational neuroscience is to find simple, tractable models that are nevertheless flexible enough to capture the response properties of real neurons. Here we examine the capabilities of recurrent point process models known as Poisson generalized linear models (GLMs). These models are defined by a s...

journal_title：Neural computation

authors： Weber AI,Pillow JW

更新日期：2017-12-01 00:00:00

abstract：:In this note, we demonstrate that the high firing irregularity produced by the leaky integrate-and-fire neuron with the partial somatic reset mechanism, which has been shown to be the most likely candidate to reflect the mechanism used in the brain for reproducing the highly irregular cortical neuron firing at high ra...

journal_title：Neural computation

authors： Christodoulou C,Cleanthous A

更新日期：2011-03-01 00:00:00