Behavioral analysis of differential Hebbian learning in closed-loop systems.

Abstract:

:Understanding closed loop behavioral systems is a non-trivial problem, especially when they change during learning. Descriptions of closed loop systems in terms of information theory date back to the 1950s, however, there have been only a few attempts which take into account learning, mostly measuring information of inputs. In this study we analyze a specific type of closed loop system by looking at the input as well as the output space. For this, we investigate simulated agents that perform differential Hebbian learning (STDP). In the first part we show that analytical solutions can be found for the temporal development of such systems for relatively simple cases. In the second part of this study we try to answer the following question: How can we predict which system from a given class would be the best for a particular scenario? This question is addressed using energy, input/output ratio and entropy measures and investigating their development during learning. This way we can show that within well-specified scenarios there are indeed agents which are optimal with respect to their structure and adaptive properties.

journal_name

Biol Cybern

journal_title

Biological cybernetics

authors

Kulvicius T,Kolodziejski C,Tamosiunaite M,Porr B,Wörgötter F

doi

10.1007/s00422-010-0396-4

subject

Has Abstract

pub_date

2010-10-01 00:00:00

pages

255-71

issue

4

eissn

0340-1200

issn

1432-0770

journal_volume

103

pub_type

杂志文章
  • Hebbian mechanisms help explain development of multisensory integration in the superior colliculus: a neural network model.

    abstract::The superior colliculus (SC) integrates relevant sensory information (visual, auditory, somatosensory) from several cortical and subcortical structures, to program orientation responses to external events. However, this capacity is not present at birth, and it is acquired only through interactions with cross-modal eve...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-012-0511-9

    authors: Cuppini C,Magosso E,Rowland B,Stein B,Ursino M

    更新日期:2012-12-01 00:00:00

  • Visual localization of briefly presented peripheral targets.

    abstract::Reported here are the results from two experiments designed to investigate Mateeff and Gourevich's (1983, 1984) claim that adult observers make large constant errors when judging the direction of briefly presented peripheral targets, with respect to a continuously visible scale. Experiment 1 involved a virtually exact...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00204123

    authors: Mapp AP,Barbeito R,Bedell HE,Ono H

    更新日期:1989-01-01 00:00:00

  • Wavelet entropy in event-related potentials: a new method shows ordering of EEG oscillations.

    abstract::In this work we show the application of a measure of entropy defined from the wavelet transform, namely the wavelet entropy (WS), to the study of event-related potentials (ERPs). WS was computed for ERPs recorded from nine healthy subjects with three different types of stimuli, among them target stimuli in a cognitive...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s004220000212

    authors: Quiroga RQ,Rosso OA,Başar E,Schürmann M

    更新日期:2001-04-01 00:00:00

  • A visual model for object detection based on active contours and level-set method.

    abstract::A visual model for object detection is proposed. In order to make the detection ability comparable with existing technical methods for object detection, an evolution equation of neurons in the model is derived from the computational principle of active contours. The hierarchical structure of the model emerges naturall...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-006-0088-2

    authors: Satoh S

    更新日期:2006-09-01 00:00:00

  • Detection of simple radially symmetric targets: further evidence for the matched filter processing scheme in human pattern detection.

    abstract::The detection of small radially symmetric targets was studied using a subthreshold summation paradigm. Small disc and disc-like patterns with diameters up to 0.60 were used for superposition on Bessel functions of zero order, subthreshold contrast and various spatial frequencies. Contrast interrelation functions prove...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s004220170005

    authors: Mortensen U,Meinhardt G

    更新日期:2001-01-01 00:00:00

  • Bistability and the dynamics of periodically forced sensory neurons.

    abstract::Many neurons at the sensory periphery receive periodic input, and their activity exhibits entrainment to this input in the form of a preferred phase for firing. This article describes a modeling study of neurons which skip a random number of cycles of the stimulus between firings over a large range of input intensitie...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00198810

    authors: Longtin A,Bulsara A,Pierson D,Moss F

    更新日期:1994-01-01 00:00:00

  • Topological maps of protein sequences.

    abstract::A new method based on neural networks to cluster proteins into families is described. The network is trained with the Kohonen unsupervised learning algorithm, using matrix pattern representations of the protein sequences as inputs. The components (x, y) of these 20 x 20 matrix patterns are the normalized frequencies o...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00204658

    authors: Ferrán EA,Ferrara P

    更新日期:1991-01-01 00:00:00

  • Zero-crossing detectors in primary visual cortex?

    abstract::David Marr and others have hypothesized that the visual system processes complex scene information in stages, the first of which involves the detection of light intensity edges or "zero-crossings" (Marr, 1982). Ideal zero-crossing detector mechanisms have been described and modeled in terms of their possible physiolog...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00346140

    authors: Hochstein S,Spitzer H

    更新日期:1984-01-01 00:00:00

  • Combined mechanisms of neural firing rate homeostasis.

    abstract::Spikes in the membrane potential of neurons comprise the currency of information processing in the brain. The ability of neurons to convert any information present across their multiple inputs into a significant modification to the pattern of their emitted spikes depends on the rate at which they emit spikes. If the m...

    journal_title:Biological cybernetics

    pub_type: 杂志文章,评审

    doi:10.1007/s00422-018-0768-8

    authors: Miller P,Cannon J

    更新日期:2019-04-01 00:00:00

  • Recovery of surface pose from texture orientation statistics under perspective projection.

    abstract::In a seminal paper, Witkin (1981) derived a model of surface slant and tilt recovery based on the statistics of the orientations of texture elements (texels) on a planar surface. This model made use of basic mathematical properties of probability distributions to formulate a posterior distribution on slant and tilt gi...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-010-0389-3

    authors: Warren PA,Mamassian P

    更新日期:2010-09-01 00:00:00

  • Feedback control of the limbs position during voluntary rhythmic oscillation.

    abstract::The mechanisms that control the limbs position during rhythmic voluntary oscillations were investigated in ten subjects, who were asked to synchronise the lower peak of their hand or foot rhythmic oscillations to a metronome beat. The efficacy of the "position control" was estimated by measuring the degree of synchron...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-007-0159-z

    authors: Esposti R,Cavallari P,Baldissera F

    更新日期:2007-08-01 00:00:00

  • Topography of alpha and theta oscillatory responses upon auditory and visual stimuli in humans.

    abstract::Brain resonance phenomena and induced rhythms in the brain recently gained importance in electroencephalographic, magnetoencephalographic and cellular studies (Başar and Bullock 1992). It was hypothesized that evoked potentials are superpositions of induced rhythms caused by resonance phenomena in neural populations (...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00205980

    authors: Schürmann M,Başar E

    更新日期:1994-01-01 00:00:00

  • Multi-loop representation of the segmental muscle stretch reflex. Its risk of instability.

    abstract::The multi-channel system of the segmental muscle stretch reflex arc is modelled as an arrangement of two or three parallel "component" loops coupled to each other at spinal and at muscle level. Such a model is thought to be more realistic than the usually adopted representation of the stretch reflex as a single negati...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00337401

    authors: Koehler W,Windhorst U

    更新日期:1980-01-01 00:00:00

  • Pervasive locking, saturation, asymmetric rate sensitivity and double-valuedness in crayfish stretch receptors.

    abstract::The correspondence between afferent discharges and sinusoidal length modulations (0.2--10 cps, under 10% of the natural length variations) was studied in isolated fast-adapting stretch receptor organs (FAO) of crayfish, largely using average displays of rate vs. length (or derivatives) along the cycle. Rate modulation...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00336926

    authors: Martínez OD,Kohn AF,Segundo JP

    更新日期:1983-01-01 00:00:00

  • Depth, contrast and view-based homing in outdoor scenes.

    abstract::Panoramic image differences can be used for view-based homing under natural outdoor conditions, because they increase smoothly with distance from a reference location (Zeil et al., J Opt Soc Am A 20(3):450-469, 2003). The particular shape, slope and depth of such image difference functions (IDFs) recorded at any one p...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-007-0147-3

    authors: Stürzl W,Zeil J

    更新日期:2007-05-01 00:00:00

  • Conduction along myelinated and demyelinated nerve fibres during the recovery cycle: model investigations.

    abstract::The membrane excitability changes as well as the underlying mechanisms of these changes in a normal and in a systematically paranodally demyelinated nerve fibre have been investigated by paired stimulation during the first 30 ms of the recovery cycle. The ionic current kinetics determining the observed changes in the ...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00217663

    authors: Stephanova DI

    更新日期:1989-01-01 00:00:00

  • Neural network firing-rate models on integral form: effects of temporal coupling kernels on equilibrium-state stability.

    abstract::Firing-rate models describing neural-network activity can be formulated in terms of differential equations for the synaptic drive from neurons. Such models are typically derived from more general models based on Volterra integral equations assuming exponentially decaying temporal coupling kernels describing the coupli...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-007-0167-z

    authors: Nordbø O,Wyller J,Einevoll GT

    更新日期:2007-09-01 00:00:00

  • Stochastic resonance and signal detection in an energy detector--implications for biological receptor systems.

    abstract::Stochastic resonance is demonstrated in a simple energy detector model, as a non-monotonic relationship between signal-to-noise ratio and detection of a sinusoid signal in bandpass-limited Gaussian noise. The behaviour of the model detecting signals of various intensities and signal-to-noise ratios was investigated. S...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s004220000176

    authors: Tougaard J

    更新日期:2000-11-01 00:00:00

  • A neural network model for the mechanism of feature-extraction. A self-organizing network with feedback inhibition.

    abstract::We propose a new multilayered neural network model which has the ability of rapid self-organization. This model is a modified version of the cognitron (Fukushima, 1975). It has modifiable inhibitory feedback connections, as well as conventional modifiable excitatory feedforward connections, between the cells of adjoin...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00336963

    authors: Miyake S,Fukushima K

    更新日期:1984-01-01 00:00:00

  • Langevin machine: a neural network based on stochastically justifiable sigmoidal function.

    abstract::In neural networks the activation process controls the output as a nonlinear function of the input; and, this output remains bounded between limits as decided by a logistic function known as the sigmoid (S-shaped). Presently, by applying the considerations of Maxwell-Boltzmann statistics, the Langevin function is show...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00216966

    authors: Neelakanta PS,Sudhakar R,DeGroff D

    更新日期:1991-01-01 00:00:00

  • "Neural" computation of decisions in optimization problems.

    abstract::Highly-interconnected networks of nonlinear analog neurons are shown to be extremely effective in computing. The networks can rapidly provide a collectively-computed solution (a digital output) to a problem on the basis of analog input information. The problems to be solved must be formulated in terms of desired optim...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00339943

    authors: Hopfield JJ,Tank DW

    更新日期:1985-01-01 00:00:00

  • The emergence of long-lasting transients of activity in simple neural networks.

    abstract::The question was investigated whether long-lasting transients of activity, observed to occur in the intact cerebral cortex (EEG slow (delta) waves and 'K' complexes) as well as in isolated tissues cultured in vitro, can also emerge in a model network of excitatory and inhibitory cells. We show that such transients can...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00204400

    authors: van Ooyen A,van Pelt J,Corner MA,da Silva FH

    更新日期:1992-01-01 00:00:00

  • The response of cortical neurons to in vivo-like input current: theory and experiment: II. Time-varying and spatially distributed inputs.

    abstract::The response of a population of neurons to time-varying synaptic inputs can show a rich phenomenology, hardly predictable from the dynamical properties of the membrane's inherent time constants. For example, a network of neurons in a state of spontaneous activity can respond significantly more rapidly than each single...

    journal_title:Biological cybernetics

    pub_type: 杂志文章,评审

    doi:10.1007/s00422-008-0270-9

    authors: Giugliano M,La Camera G,Fusi S,Senn W

    更新日期:2008-11-01 00:00:00

  • Information filtering by coincidence detection of synchronous population output: analytical approaches to the coherence function of a two-stage neural system.

    abstract::Information about time-dependent sensory stimuli is encoded in the activity of neural populations; distinct aspects of the stimulus are read out by different types of neurons: while overall information is perceived by integrator cells, so-called coincidence detector cells are driven mainly by the synchronous activity ...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-020-00838-6

    authors: Bostner Ž,Knoll G,Lindner B

    更新日期:2020-06-01 00:00:00

  • Generation of periodic and chaotic bursting in an excitable cell model.

    abstract::There are interesting oscillatory phenomena associated with excitable cells that require theoretical insight. Some of these phenomena are: the threshold low amplitude oscillations before bursting in neuronal cells, the damped burst observed in muscle cells, the period-adding bifurcations without chaos in pancreatic be...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00198918

    authors: Fan YS,Chay TR

    更新日期:1994-01-01 00:00:00

  • Mathematical formulations of Hebbian learning.

    abstract::Several formulations of correlation-based Hebbian learning are reviewed. On the presynaptic side, activity is described either by a firing rate or by presynaptic spike arrival. The state of the postsynaptic neuron can be described by its membrane potential, its firing rate, or the timing of backpropagating action pote...

    journal_title:Biological cybernetics

    pub_type: 杂志文章,评审

    doi:10.1007/s00422-002-0353-y

    authors: Gerstner W,Kistler WM

    更新日期:2002-12-01 00:00:00

  • Modelling place memory in crickets.

    abstract::Insects can remember and return to a place of interest using the surrounding visual cues. In previous experiments, we showed that crickets could home to an invisible cool spot in a hot environment. They did so most effectively with a natural scene surround, though they were also able to home with distinct landmarks or...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-009-0338-1

    authors: Mangan M,Webb B

    更新日期:2009-10-01 00:00:00

  • Contrast Discrimination by the human visual system.

    abstract::In vision of everyday scenes, features requiring detection are frequently observed in the presence of suprathreshold background structures. Detection of such features is a contrast discrimination task and is often necessary for the subsequent process of recognition. In order to provide a description of this task, cont...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00326678

    authors: Burton GJ

    更新日期:1981-01-01 00:00:00

  • Simulating Small Neural Circuits with a Discrete Computational Model.

    abstract::Simulations of neural activity are commonly based on differential equations. We address the question what can be achieved with a simplified discrete model. The proposed model resembles artificial neural networks enriched with additional biologically inspired features. A neuron has several states, and the state transit...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-020-00826-w

    authors: Bazenkov NI,Boldyshev BA,Dyakonova V,Kuznetsov OP

    更新日期:2020-06-01 00:00:00

  • Minimum mean square error estimation of connectivity in biological neural networks.

    abstract::A minimum mean square error (MMSE) estimation scheme is employed to identify the synaptic connectivity in neural networks. This new approach can substantially reduce the amount of data and the computational cost involved in the conventional correlation methods, and is suitable for both nonstationary and stationary neu...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00198088

    authors: Yang X,Shamma SA

    更新日期:1991-01-01 00:00:00