Abstract：
:To exhibit social intelligence, animals have to recognize whom they are communicating with. One way to make this inference is to select among internal generative models of each conspecific who may be encountered. However, these models also have to be learned via some form of Bayesian belief updating. This induces an interesting problem: When receiving sensory input generated by a particular conspecific, how does an animal know which internal model to update? We consider a theoretical and neurobiologically plausible solution that enables inference and learning of the processes that generate sensory inputs (e.g., listening and understanding) and reproduction of those inputs (e.g., talking or singing), under multiple generative models. This is based on recent advances in theoretical neurobiology-namely, active inference and post hoc (online) Bayesian model selection. In brief, this scheme fits sensory inputs under each generative model. Model parameters are then updated in proportion to the probability that each model could have generated the input (i.e., model evidence). The proposed scheme is demonstrated using a series of (real zebra finch) birdsongs, where each song is generated by several different birds. The scheme is implemented using physiologically plausible models of birdsong production. We show that generalized Bayesian filtering, combined with model selection, leads to successful learning across generative models, each possessing different parameters. These results highlight the utility of having multiple internal models when making inferences in social environments with multiple sources of sensory information.
journal_name
Neural Computjournal_title
Neural computationauthors
Isomura T,Parr T,Friston Kdoi
10.1162/neco_a_01239subject
Has Abstractpub_date
2019-12-01 00:00:00pages
2390-2431issue
12eissn
0899-7667issn
1530-888Xjournal_volume
31pub_type
杂志文章abstract：:Controlling for multiple hypothesis tests using standard spike resampling techniques often requires prohibitive amounts of computation. Importance sampling techniques can be used to accelerate the computation. The general theory is presented, along with specific examples for testing differences across conditions using...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00399
更新日期：2013-02-01 00:00:00
abstract：:Mechanisms influencing learning in neural networks are usually investigated on either a local or a global scale. The former relates to synaptic processes, the latter to unspecific modulatory systems. Here we study the interaction of a local learning rule that evaluates coincidences of pre- and postsynaptic action pote...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976600300015682
更新日期：2000-03-01 00:00:00
abstract：:Synaptic runaway denotes the formation of erroneous synapses and premature functional decline accompanying activity-dependent learning in neural networks. This work studies synaptic runaway both analytically and numerically in binary-firing associative memory networks. It turns out that synaptic runaway is of fairly m...
journal_title：Neural computation
pub_type： 杂志文章,评审
doi：10.1162/089976698300017836
更新日期：1998-02-15 00:00:00
abstract：:The brain is known to be active even when not performing any overt cognitive tasks, and often it engages in involuntary mind wandering. This resting state has been extensively characterized in terms of fMRI-derived brain networks. However, an alternate method has recently gained popularity: EEG microstate analysis. Pr...
journal_title：Neural computation
pub_type： 信件
doi：10.1162/neco_a_01229
更新日期：2019-11-01 00:00:00
abstract：:Inner-product operators, often referred to as kernels in statistical learning, define a mapping from some input space into a feature space. The focus of this letter is the construction of biologically motivated kernels for cortical activities. The kernels we derive, termed Spikernels, map spike count sequences into an...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/0899766053019944
更新日期：2005-03-01 00:00:00
abstract：:When we move our body to perform a movement task, our central nervous system selects a movement trajectory from an infinite number of possible trajectories under constraints that have been acquired through evolution and learning. Minimization of the energy cost has been suggested as a potential candidate for a constra...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00757
更新日期：2015-08-01 00:00:00
abstract：:In "Isotropic Sequence Order Learning" (pp. 831-864 in this issue), we introduced a novel algorithm for temporal sequence learning (ISO learning). Here, we embed this algorithm into a formal nonevaluating (teacher free) environment, which establishes a sensor-motor feedback. The system is initially guided by a fixed r...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/08997660360581930
更新日期：2003-04-01 00:00:00
abstract：:Slightly modified versions of an early Hebbian/anti-Hebbian neural network are shown to be capable of extracting the sparse, independent linear components of a prefiltered natural image set. An explanation for this capability in terms of a coupling between two hypothetical networks is presented. The simple networks pr...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976606775093891
更新日期：2006-02-01 00:00:00
abstract：:The goal of sufficient dimension reduction in supervised learning is to find the low-dimensional subspace of input features that contains all of the information about the output values that the input features possess. In this letter, we propose a novel sufficient dimension-reduction method using a squared-loss variant...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00407
更新日期：2013-03-01 00:00:00
abstract：:Due to many experimental reports of synchronous neural activity in the brain, there is much interest in understanding synchronization in networks of neural oscillators and its potential for computing perceptual organization. Contrary to Hopfield and Herz (1995), we find that networks of locally coupled integrate-and-f...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976699300016160
更新日期：1999-10-01 00:00:00
abstract：:Humans have the ability to learn novel motor tasks while manipulating the environment. Several models of motor learning have been proposed in the literature, but few of them address the problem of retention and interference of motor memory. The modular selection and identification for control (MOSAIC) model, originall...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco.2009.03-08-721
更新日期：2009-07-01 00:00:00
abstract：:Characterizing neural spiking activity as a function of intrinsic and extrinsic factors is important in neuroscience. Point process models are valuable for capturing such information; however, the process of fully applying these models is not always obvious. A complete model application has four broad steps: specifica...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00198
更新日期：2011-11-01 00:00:00
abstract：:An iterative reweighted least squares (IRWLS) procedure recently proposed is shown to converge to the support vector machine solution. The convergence to a stationary point is ensured by modifying the original IRWLS procedure. ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/0899766052530875
更新日期：2005-01-01 00:00:00
abstract：:A single-layered Hough transform network is proposed that accepts image coordinates of each object pixel as input and produces a set of outputs that indicate the belongingness of the pixel to a particular structure (e.g., a straight line). The network is able to learn adaptively the parametric forms of the linear segm...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976601300014501
更新日期：2001-03-01 00:00:00
abstract：:The mutual information between a set of stimuli and the elicited neural responses is compared to the corresponding decoded information. The decoding procedure is presented as an artificial distortion of the joint probabilities between stimuli and responses. The information loss is quantified. Whenever the probabilitie...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976602317318947
更新日期：2002-04-01 00:00:00
abstract：:High-density electrocorticogram (ECoG) electrodes are capable of recording neurophysiological data with high temporal resolution with wide spatial coverage. These recordings are a window to understanding how the human brain processes information and subsequently behaves in healthy and pathologic states. Here, we descr...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco_a_01009
更新日期：2017-12-01 00:00:00
abstract：:Field models provide an elegant mathematical framework to analyze large-scale patterns of neural activity. On the microscopic level, these models are usually based on either a firing-rate picture or integrate-and-fire dynamics. This article shows that in spite of the large conceptual differences between the two types ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/08997660260028656
更新日期：2002-07-01 00:00:00
abstract：:We explicitly analyze the trajectories of learning near singularities in hierarchical networks, such as multilayer perceptrons and radial basis function networks, which include permutation symmetry of hidden nodes, and show their general properties. Such symmetry induces singularities in their parameter space, where t...
journal_title：Neural computation
pub_type： 信件
doi：10.1162/neco.2007.12-06-414
更新日期：2008-03-01 00:00:00
abstract：:To date, Hebbian learning combined with some form of constraint on synaptic inputs has been demonstrated to describe well the development of neural networks. The previous models revealed mathematically the importance of synaptic constraints to reproduce orientation selectivity in the visual cortical neurons, but biolo...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco.2009.04-08-752
更新日期：2009-09-01 00:00:00
abstract：:In this letter, we investigate the fundamental limits on how the interspike time of a neuron oscillator can be perturbed by the application of a bounded external control input (a current stimulus) with zero net electric charge accumulation. We use phase models to study the dynamics of neurons and derive charge-balance...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00643
更新日期：2014-10-01 00:00:00
abstract：:We consider the problem of training a linear feedforward neural network by using a gradient descent-like LMS learning algorithm. The objective is to find a weight matrix for the network, by repeatedly presenting to it a finite set of examples, so that the sum of the squares of the errors is minimized. Kohonen showed t...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco.1991.3.2.226
更新日期：1991-07-01 00:00:00
abstract：:In a pioneering classic, Warren McCulloch and Walter Pitts proposed a model of the central nervous system. Motivated by EEG recordings of normal brain activity, Chvátal and Goldsmith asked whether these dynamical systems can be engineered to produce trajectories that are irregular, disorderly, and apparently unpredict...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00841
更新日期：2016-06-01 00:00:00
abstract：:Experimental studies of reasoning and planned behavior have provided evidence that nervous systems use internal models to perform predictive motor control, imagery, inference, and planning. Classical (model-free) reinforcement learning approaches omit such a model; standard sensorimotor models account for forward and ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976606776240995
更新日期：2006-05-01 00:00:00
abstract：:We study active learning (AL) based on gaussian processes (GPs) for efficiently enumerating all of the local minimum solutions of a black-box function. This problem is challenging because local solutions are characterized by their zero gradient and positive-definite Hessian properties, but those derivatives cannot be ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco_a_01307
更新日期：2020-10-01 00:00:00
abstract：:We generalize recent theoretical work on the minimal number of layers of narrow deep belief networks that can approximate any probability distribution on the states of their visible units arbitrarily well. We relax the setting of binary units (Sutskever & Hinton, 2008 ; Le Roux & Bengio, 2008 , 2010 ; Montúfar & Ay, 2...
journal_title：Neural computation
pub_type： 信件
doi：10.1162/NECO_a_00601
更新日期：2014-07-01 00:00:00
abstract：:We consider learning a causal ordering of variables in a linear nongaussian acyclic model called LiNGAM. Several methods have been shown to consistently estimate a causal ordering assuming that all the model assumptions are correct. But the estimation results could be distorted if some assumptions are violated. In thi...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00533
更新日期：2014-01-01 00:00:00
abstract：:In learning theory, the training and test sets are assumed to be drawn from the same probability distribution. This assumption is also followed in practical situations, where matching the training and test distributions is considered desirable. Contrary to conventional wisdom, we show that mismatched training and test...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00697
更新日期：2015-02-01 00:00:00
abstract：:The need to reason about uncertainty in large, complex, and multimodal data sets has become increasingly common across modern scientific environments. The ability to transform samples from one distribution journal_title：Neural computation pub_type： 杂志文章 doi：10.1162/neco_a_01172 更新日期：2019-04-01 00:00:00
abstract：:Ordinal classification (also known as ordinal regression) is a supervised learning task that consists of estimating the rating of a data item on a fixed, discrete rating scale. This problem is receiving increased attention from the sentiment analysis and opinion mining community due to the importance of automatically ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00558
更新日期：2014-03-01 00:00:00
abstract：:The new time-organized map (TOM) is presented for a better understanding of the self-organization and geometric structure of cortical signal representations. The algorithm extends the common self-organizing map (SOM) from the processing of purely spatial signals to the processing of spatiotemporal signals. The main ad...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976603765202695
更新日期：2003-05-01 00:00:00
