Abstract：
:In this letter, we propose a noisy nonlinear version of independent component analysis (ICA). Assuming that the probability density function (p. d. f.) of sources is known, a learning rule is derived based on maximum likelihood estimation (MLE). Our model involves some algorithms of noisy linear ICA (e. g., Bermond & Cardoso, 1999) or noise-free nonlinear ICA (e. g., Lee, Koehler, & Orglmeister, 1997) as special cases. Especially when the nonlinear function is linear, the learning rule derived as a generalized expectation-maximization algorithm has a similar form to the noisy ICA algorithm previously presented by Douglas, Cichocki, and Amari (1998). Moreover, our learning rule becomes identical to the standard noise-free linear ICA algorithm in the noiseless limit, while existing MLE-based noisy ICA algorithms do not rigorously include the noise-free ICA. We trained our noisy nonlinear ICA by using acoustic signals such as speech and music. The model after learning successfully simulates virtual pitch phenomena, and the existence region of virtual pitch is qualitatively similar to that observed in a psychoacoustic experiment. Although a linear transformation hypothesized in the central auditory system can account for the pitch sensation, our model suggests that the linear transformation can be acquired through learning from actual acoustic signals. Since our model includes a cepstrum analysis in a special case, it is expected to provide a useful feature extraction method that has often been given by the cepstrum analysis.
journal_name
Neural Computjournal_title
Neural computationauthors
Maeda S,Song WJ,Ishii Sdoi
10.1162/0899766052530866subject
Has Abstractpub_date
2005-01-01 00:00:00pages
115-44issue
1eissn
0899-7667issn
1530-888Xjournal_volume
17pub_type
杂志文章abstract：:The ability to achieve high swimming speed and efficiency is very important to both the real lamprey and its robotic implementation. In previous studies, we used evolutionary algorithms to evolve biologically plausible connectionist swimming controllers for a simulated lamprey. This letter investigates the robustness ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco.2007.19.6.1568
更新日期：2007-06-01 00:00:00
abstract：:Energy-efficient information transmission may be relevant to biological sensory signal processing as well as to low-power electronic devices. We explore its consequences in two different regimes. In an "immediate" regime, we argue that the information rate should be maximized subject to a power constraint, and in an "...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976601300014358
更新日期：2001-04-01 00:00:00
abstract：:Integrate-and-express models of synaptic plasticity propose that synapses integrate plasticity induction signals before expressing synaptic plasticity. By discerning trends in their induction signals, synapses can control destabilizing fluctuations in synaptic strength. In a feedforward perceptron framework with binar...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00889
更新日期：2016-11-01 00:00:00
abstract：:We consider the effect of the effective timing of a delayed feedback on the excitatory neuron in a recurrent inhibitory loop, when biological realities of firing and absolute refractory period are incorporated into a phenomenological spiking linear or quadratic integrate-and-fire neuron model. We show that such models...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco.2007.19.8.2124
更新日期：2007-08-01 00:00:00
abstract：:We have studied some of the design trade-offs governing visual representations based on spatially invariant conjunctive feature detectors, with an emphasis on the susceptibility of such systems to false-positive recognition errors-Malsburg's classical binding problem. We begin by deriving an analytical model that make...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976600300015574
更新日期：2000-04-01 00:00:00
abstract：:Mechanisms influencing learning in neural networks are usually investigated on either a local or a global scale. The former relates to synaptic processes, the latter to unspecific modulatory systems. Here we study the interaction of a local learning rule that evaluates coincidences of pre- and postsynaptic action pote...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976600300015682
更新日期：2000-03-01 00:00:00
abstract：:The Hebbian paradigm is perhaps the best-known unsupervised learning theory in connectionism. It has inspired wide research activity in the artificial neural network field because it embodies some interesting properties such as locality and the capability of being applicable to the basic weight-and-sum structure of ne...
journal_title：Neural computation
pub_type： 杂志文章,评审
doi：10.1162/0899766053429381
更新日期：2005-04-01 00:00:00
abstract：:We present a first-order nonhomogeneous Markov model for the interspike-interval density of a continuously stimulated spiking neuron. The model allows the conditional interspike-interval density and the stationary interspike-interval density to be expressed as products of two separate functions, one of which describes...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco.2009.06-07-548
更新日期：2009-06-01 00:00:00
abstract：:A hierarchical dynamical map is proposed as the basic framework for sensory cortical mapping. To show how the hierarchical dynamical map works in cognitive processes, we applied it to a typical cognitive task known as priming, in which cognitive performance is facilitated as a consequence of prior experience. Prior to...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/08997660152469341
更新日期：2001-08-01 00:00:00
abstract：:Previous studies have combined analytical models of stochastic neural responses with signal detection theory (SDT) to predict psychophysical performance limits; however, these studies have typically been limited to simple models and simple psychophysical tasks. A companion article in this issue ("Evaluating Auditory P...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976601750541813
更新日期：2001-10-01 00:00:00
abstract：:We present a new supervised learning procedure for ensemble machines, in which outputs of predictors, trained on different distributions, are combined by a dynamic classifier combination model. This procedure may be viewed as either a version of mixture of experts (Jacobs, Jordan, Nowlan, & Hintnon, 1991), applied to ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976699300016737
更新日期：1999-02-15 00:00:00
abstract：:A modular, recurrent connectionist network is taught to incrementally parse complex sentences. From input presented one word at a time, the network learns to do semantic role assignment, noun phrase attachment, and clause structure recognition, for sentences with both active and passive constructions and center-embedd...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco.1991.3.1.110
更新日期：1991-04-01 00:00:00
abstract：:The prevalence of coherent oscillations in various frequency ranges in the central nervous system raises the question of the mechanisms that synchronize large populations of neurons. We study synchronization in models of large networks of spiking neurons with random sparse connectivity. Synchrony occurs only when the ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976600300015529
更新日期：2000-05-01 00:00:00
abstract：:Nondeclarative memory and novelty processing in the brain is an actively studied field of neuroscience, and reducing neural activity with repetition of a stimulus (repetition suppression) is a commonly observed phenomenon. Recent findings of an opposite trend-specifically, rising activity for unfamiliar stimuli-questi...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00569
更新日期：2014-04-01 00:00:00
abstract：:Perceiving and identifying an object is improved by prior exposure to the object. This perceptual priming phenomenon is accompanied by reduced neural activity. But whether suppression of neuronal activity with priming is responsible for the improvement in perception is unclear. To address this problem, we developed a ...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco.2009.04-09-999
更新日期：2010-05-01 00:00:00
abstract：:Integrate-and-fire neurons are time encoding machines that convert the amplitude of an analog signal into a nonuniform, strictly increasing sequence of spike times. Under certain conditions, the encoded signals can be reconstructed from the nonuniform spike time sequences using a time decoding machine. Time encoding a...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00764
更新日期：2015-09-01 00:00:00
abstract：:The need to reason about uncertainty in large, complex, and multimodal data sets has become increasingly common across modern scientific environments. The ability to transform samples from one distribution journal_title：Neural computation pub_type： 杂志文章 doi：10.1162/neco_a_01172 更新日期：2019-04-01 00:00:00
abstract：:Spiking neural P systems (SN P systems) are a class of distributed parallel computing devices inspired by spiking neurons, where the spiking rules are usually used in a sequential way (an applicable rule is applied one time at a step) or an exhaustive way (an applicable rule is applied as many times as possible at a s...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00665
更新日期：2014-12-01 00:00:00
abstract：:Many different types of integrate-and-fire models have been designed in order to explain how it is possible for a cortical neuron to integrate over many independent inputs while still producing highly variable spike trains. Within this context, the variability of spike trains has been almost exclusively measured using...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/0899766041732413
更新日期：2004-10-01 00:00:00
abstract：:We considered a gamma distribution of interspike intervals as a statistical model for neuronal spike generation. A gamma distribution is a natural extension of the Poisson process taking the effect of a refractory period into account. The model is specified by two parameters: a time-dependent firing rate and a shape p...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco.2006.18.10.2359
更新日期：2006-10-01 00:00:00
abstract：:Topographic maps such as the self-organizing map (SOM) or neural gas (NG) constitute powerful data mining techniques that allow simultaneously clustering data and inferring their topological structure, such that additional features, for example, browsing, become available. Both methods have been introduced for vectori...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00012
更新日期：2010-09-01 00:00:00
abstract：:A significant threat to the recent, wide deployment of machine learning-based systems, including deep neural networks (DNNs), is adversarial learning attacks. The main focus here is on evasion attacks against DNN-based classifiers at test time. While much work has focused on devising attacks that make small perturbati...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco_a_01209
更新日期：2019-08-01 00:00:00
abstract：:We generalize recent theoretical work on the minimal number of layers of narrow deep belief networks that can approximate any probability distribution on the states of their visible units arbitrarily well. We relax the setting of binary units (Sutskever & Hinton, 2008 ; Le Roux & Bengio, 2008 , 2010 ; Montúfar & Ay, 2...
journal_title：Neural computation
pub_type： 信件
doi：10.1162/NECO_a_00601
更新日期：2014-07-01 00:00:00
abstract：:Reservoir computing is a biologically inspired class of learning algorithms in which the intrinsic dynamics of a recurrent neural network are mined to produce target time series. Most existing reservoir computing algorithms rely on fully supervised learning rules, which require access to an exact copy of the target re...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco_a_01198
更新日期：2019-07-01 00:00:00
abstract：:The successor representation was introduced into reinforcement learning by Dayan ( 1993 ) as a means of facilitating generalization between states with similar successors. Although reinforcement learning in general has been used extensively as a model of psychological and neural processes, the psychological validity o...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00282
更新日期：2012-06-01 00:00:00
abstract：:Regression aims at estimating the conditional mean of output given input. However, regression is not informative enough if the conditional density is multimodal, heteroskedastic, and asymmetric. In such a case, estimating the conditional density itself is preferable, but conditional density estimation (CDE) is challen...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00683
更新日期：2015-01-01 00:00:00
abstract：:When we move our body to perform a movement task, our central nervous system selects a movement trajectory from an infinite number of possible trajectories under constraints that have been acquired through evolution and learning. Minimization of the energy cost has been suggested as a potential candidate for a constra...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/NECO_a_00757
更新日期：2015-08-01 00:00:00
abstract：:We analyze convergence of the expectation maximization (EM) and variational Bayes EM (VBEM) schemes for parameter estimation in noisy linear models. The analysis shows that both schemes are inefficient in the low-noise limit. The linear model with additive noise includes as special cases independent component analysis...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/0899766054322991
更新日期：2005-09-01 00:00:00
abstract：:In this work, we propose a two-layered descriptive model for motion processing from retina to the cortex, with an event-based input from the asynchronous time-based image sensor (ATIS) camera. Spatial and spatiotemporal filtering of visual scenes by motion energy detectors has been implemented in two steps in a simple...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/neco_a_01191
更新日期：2019-06-01 00:00:00
abstract：:In considering a statistical model selection of neural networks and radial basis functions under an overrealizable case, the problem of unidentifiability emerges. Because the model selection criterion is an unbiased estimator of the generalization error based on the training error, this article analyzes the expected t...
journal_title：Neural computation
pub_type： 杂志文章
doi：10.1162/089976602760128090
更新日期：2002-08-01 00:00:00
