Synthesis of nonlinear control surfaces by a layered associative search network.

Abstract:

:An approach to solving nonlinear control problems is illustrated by means of a layered associative network composed of adaptive elements capable of reinforcement learning. The first layer adaptively develops a representation in terms of which the second layer can solve the problem linearly. The adaptive elements comprising the network employ a novel type of learning rule whose properties, we argue, are essential to the adaptive behavior of the layered network. The behavior of the network is illustrated by means of a spatial learning problem that requires the formation of nonlinear associations. We argue that this approach to nonlinearity can be extended to a large class of nonlinear control problems.

journal_name

Biol Cybern

journal_title

Biological cybernetics

authors

Barto AG,Anderson CW,Sutton RS

doi

10.1007/BF00319977

subject

Has Abstract

pub_date

1982-01-01 00:00:00

pages

175-85

issue

3

eissn

0340-1200

issn

1432-0770

journal_volume

43

pub_type

杂志文章
  • Three-dimensional kinematic analysis of influence of hand orientation and joint limits on the control of arm postures and movements.

    abstract::The problems related to kinematic redundancy in both task and joint space were investigated for arm prehension movements in this paper. After a detailed analysis of kinematic redundancy of the arm, it is shown that the redundancy problem is ill posed only for the control of hand orientation. An experiment was then des...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s004220050538

    authors: Wang X

    更新日期:1999-06-01 00:00:00

  • A central back-coupling hypothesis on the organization of motor synergies: a physical metaphor and a neural model.

    abstract::We offer a hypothesis on the organization of multi-effector motor synergies and illustrate it with the task of force production with a set of fingers. A physical metaphor, a leaking bucket, is analyzed to demonstrate that an inanimate structure can show apparent error compensation among its elements. A neural model is...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-005-0548-0

    authors: Latash ML,Shim JK,Smilga AV,Zatsiorsky VM

    更新日期:2005-03-01 00:00:00

  • Structural study of the development of ocularity domains using a neural network model.

    abstract::We present a model for the development of ocularity domains in the visual cortex of mammals during the embryonic stage. We model the thalamo-cortical pathway with a self-organising neural network with two source layers, each of them serving different retinae, and one target layer, where the connections end. The connec...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00652225

    authors: Andrade MA,Morán F

    更新日期:1996-03-01 00:00:00

  • Equation of motion and general solution for the one-dimensional complex cell response in the signal-tuned approach.

    abstract::A signal-tuned approach has been recently introduced for modeling stimulus-dependent cortical receptive fields. The approach is based on signal-tuned Gabor functions, which are Gaussian-modulated sinusoids whose parameters are obtained from a "tuning" signal. Given a stimulus to a cell, it is taken as the tuning signa...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-015-0653-7

    authors: Torreão JR

    更新日期:2015-10-01 00:00:00

  • A ring model for spatiotemporal properties of simple cells in the visual cortex.

    abstract::A neural model is proposed for the spatiotemporal properties of simple cells in the visual cortex. In the model, several cortical cells are arranged on a ring, with mutual excitatory or inhibitory connections. The cells also receive excitatory inputs either from lagged and nonlagged cells of the lateral geniculate nuc...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s004220050383

    authors: Hamada T,Yamashima M,Kato K

    更新日期:1997-10-01 00:00:00

  • Comparing internal models of the dynamics of the visual environment.

    abstract::It is well known that the human postural control system responds to motion of the visual scene, but the implicit assumptions it makes about the visual environment and what quantities, if any, it estimates about the visual environment are unknown. This study compares the behavior of four models of the human postural co...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-004-0535-x

    authors: Carver S,Kiemel T,van der Kooij H,Jeka JJ

    更新日期:2005-03-01 00:00:00

  • Wavelet entropy in event-related potentials: a new method shows ordering of EEG oscillations.

    abstract::In this work we show the application of a measure of entropy defined from the wavelet transform, namely the wavelet entropy (WS), to the study of event-related potentials (ERPs). WS was computed for ERPs recorded from nine healthy subjects with three different types of stimuli, among them target stimuli in a cognitive...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s004220000212

    authors: Quiroga RQ,Rosso OA,Başar E,Schürmann M

    更新日期:2001-04-01 00:00:00

  • Adaptive synaptogenesis constructs networks that maintain information and reduce statistical dependence.

    abstract::This report demonstrates the effectiveness of two processes in constructing simple feedforward networks which perform good transformations on their inputs. Good transformations are characterized by the minimization of two information measures: the information loss incurred with the transformation and the statistical d...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00202569

    authors: Adelsberger-Mangan DM,Levy WB

    更新日期:1993-01-01 00:00:00

  • A cardioid oscillator with asymmetric time ratio for establishing CPG models.

    abstract::Nonlinear oscillators are usually utilized by bionic scientists for establishing central pattern generator models for imitating rhythmic motions by bionic scientists. In the natural word, many rhythmic motions possess asymmetric time ratios, which means that the forward and the backward motions of an oscillating proce...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-018-0746-1

    authors: Fu Q,Wang DH,Xu L,Yuan G

    更新日期:2018-06-01 00:00:00

  • Estimating parameters and predicting membrane voltages with conductance-based neuron models.

    abstract::Recent results demonstrate techniques for fully quantitative, statistical inference of the dynamics of individual neurons under the Hodgkin-Huxley framework of voltage-gated conductances. Using a variational approximation, this approach has been successfully applied to simulated data from model neurons. Here, we use t...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-014-0615-5

    authors: Meliza CD,Kostuk M,Huang H,Nogaret A,Margoliash D,Abarbanel HD

    更新日期:2014-08-01 00:00:00

  • Minimum mean square error estimation of connectivity in biological neural networks.

    abstract::A minimum mean square error (MMSE) estimation scheme is employed to identify the synaptic connectivity in neural networks. This new approach can substantially reduce the amount of data and the computational cost involved in the conventional correlation methods, and is suitable for both nonstationary and stationary neu...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00198088

    authors: Yang X,Shamma SA

    更新日期:1991-01-01 00:00:00

  • The relationship between absolute disparity and ocular vergence.

    abstract::The relationship between disparity and ocular vergence was investigated under closed-loop as well as under open-loop viewing conditions. First we examined whether vergence responded similarly to disparity presented under open-loop and closed-loop conditions. Similar response were observed in both conditions. The direc...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00224855

    authors: Pobuda M,Erkelens CJ

    更新日期:1993-01-01 00:00:00

  • On the comparison of Feller and Ornstein-Uhlenbeck models for neural activity.

    abstract::Diffusion processes have been extensively used to describe membrane potential behavior. In this approach the interspike interval has a theoretical counterpart in the first-passage-time of the diffusion model employed. Since the mathematical complexity of the first-passage-time problem increases with attempts to make t...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00201480

    authors: Lánský P,Sacerdote L,Tomassetti F

    更新日期:1995-10-01 00:00:00

  • Non-linear and linear forecasting of the EEG time series.

    abstract::The method of non-linear forecasting of time series was applied to different simulated signals and EEG in order to check its ability of distinguishing chaotic from noisy time series. The goodness of prediction was estimated, in terms of the correlation coefficient between forecasted and real time series, for non-linea...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00243291

    authors: Blinowska KJ,Malinowski M

    更新日期:1991-01-01 00:00:00

  • Noise effects in an electronic model of a single neuron.

    abstract::We consider a simple electronic circuit model of a single neuron. The neuron is assumed to be driven by an external signal comprising constant (dc) and random components. In addition, the nonlinearity parameter in the circuit is assumed to fluctuate, thereby giving rise to critical behavior including the onset of hyst...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00198768

    authors: Bulsara AR,Boss RD,Jacobs EW

    更新日期:1989-01-01 00:00:00

  • The frequency of seeing square wave density modulations in random dot patterns.

    abstract::A theoretical and experimental study on the detection of a square wave pattern of random dots is presented. Our theory applies to two-alternative forced choice experiments as well as to "seen"-"not seen" discrimination experiments. In our experiments we used the forced choice method. The theory provides a good descrip...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00318084

    authors: Lelkens AM,Oppeneer PM

    更新日期:1983-01-01 00:00:00

  • A neuron-inspired computational architecture for spatiotemporal visual processing: real-time visual sensory integration for humanoid robots.

    abstract::In this article, we present a neurologically motivated computational architecture for visual information processing. The computational architecture's focus lies in multiple strategies: hierarchical processing, parallel and concurrent processing, and modularity. The architecture is modular and expandable in both hardwa...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-014-0597-3

    authors: Holzbach A,Cheng G

    更新日期:2014-06-01 00:00:00

  • Phenomenological models of synaptic plasticity based on spike timing.

    abstract::Synaptic plasticity is considered to be the biological substrate of learning and memory. In this document we review phenomenological models of short-term and long-term synaptic plasticity, in particular spike-timing dependent plasticity (STDP). The aim of the document is to provide a framework for classifying and eval...

    journal_title:Biological cybernetics

    pub_type: 杂志文章,评审

    doi:10.1007/s00422-008-0233-1

    authors: Morrison A,Diesmann M,Gerstner W

    更新日期:2008-06-01 00:00:00

  • Estimation of signal and noise spectra by special averaging techniques with application to a posteriori "Wiener" filtering.

    abstract::This paper deals with the problem of separating the spectra of signal and noise in ensembles where the signal can be considered as an invariant component and the noise as a stationary additive background. Several methods are discussed and compared on the basis of a statistical analysis of the first two moments of the ...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00337392

    authors: de Weerd JP,Uyen GJ,Johannesma PI,Martens WL

    更新日期:1979-03-19 00:00:00

  • Leveraging variable sensor spatial acuity with a homogeneous, multi-scale place recognition framework.

    abstract::Most robot navigation systems perform place recognition using a single-sensor modality and one, or at most two heterogeneous map scales. In contrast, mammals perform navigation by combining sensing from a wide variety of modalities including vision, auditory, olfactory and tactile senses with a multi-scale, homogeneou...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-017-0745-7

    authors: Jacobson A,Chen Z,Milford M

    更新日期:2018-06-01 00:00:00

  • Predictive feedback in human simulated pendulum balancing.

    abstract::In studies of human balance, it is common to fit stimulus-response data by tuning the time-delay and gain parameters of a simple delayed feedback model. Many interpret this fitted model, a simple delayed feedback model, as evidence that predictive processes are not required to explain existing data on standing balance...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-009-0325-6

    authors: Gawthrop P,Loram I,Lakie M

    更新日期:2009-08-01 00:00:00

  • Reflexes and preflexes: on the role of sensory feedback on rhythmic patterns in insect locomotion.

    abstract::Neuromuscular systems are stabilized and controlled by both feedforward and feedback signals. Feedforward pathways driven by central pattern generators (CPGs), in conjunction with preflexive mechanical reaction forces and nonlinear muscle properties, can produce stable stereotypical gaits. Feedback is nonetheless pres...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-010-0383-9

    authors: Proctor J,Holmes P

    更新日期:2010-06-01 00:00:00

  • Numerical fourier transform spectroscopy of EMG half-waves: fragmentary-decomposition-based approach to nonstationary signal analysis.

    abstract::A nonstationary signal analysis technique is introduced, which regards an oscillatory physiological signal as a sum of its fragments, presented in the form of a fragmentary decomposition (FD). The virtue of FD is that it is free of the necessity to choose a priori the basis functions intended for signal analysis or sy...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s004220050575

    authors: Melkonian D,Blumenthal T,Gordon E

    更新日期:1999-11-01 00:00:00

  • A two dimensional field theory for motion computation. First order approximation; translatory motion of rigid patterns.

    abstract::The local extraction of motion information from brightness patterns by individual movement detectors of the correlation-type is considered in the first part of the paper. A two-dimensional field theory of movement detection is developed by treating the distance between two adjacent photoreceptors as a differential. In...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00205969

    authors: Reichardt WE,Schlögl RW

    更新日期:1988-01-01 00:00:00

  • A neural model for category learning.

    abstract::We present a general neural model for supervised learning of pattern categories which can resolve pattern classes separated by nonlinear, essentially arbitrary boundaries. The concept of a pattern class develops from storing in memory a limited number of class elements (prototypes). Associated with each prototype is a...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00387211

    authors: Reilly DL,Cooper LN,Elbaum C

    更新日期:1982-01-01 00:00:00

  • Computer simulation for hormones related to primary thyropathy.

    abstract::We propose a mathematical model of the human hypothalamus-anterior pituitary-thyroid system regulating basal metabolism, and practice computer simulation concerning primary thyropathy such as Graves' disease, hypothyroidism, T4-toxicosis and T3-toxicosis by use of this model. In order to throw light on properties of t...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00336982

    authors: Hatakeyama T,Yagi H

    更新日期:1985-01-01 00:00:00

  • A spiking neural network model of the midbrain superior colliculus that generates saccadic motor commands.

    abstract::Single-unit recordings suggest that the midbrain superior colliculus (SC) acts as an optimal controller for saccadic gaze shifts. The SC is proposed to be the site within the visuomotor system where the nonlinear spatial-to-temporal transformation is carried out: the population encodes the intended saccade vector by i...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-017-0719-9

    authors: Kasap B,van Opstal AJ

    更新日期:2017-08-01 00:00:00

  • A model for the economical encoding of the visual image in cerebral cortex.

    abstract::We propose a model for the first stage of the cortical transformation of the visual image based on the principle that the cortex encodes the information with the minimum number of channels mathematically needed. We restrict our model to be consistent with the data on size adaptations, the known relationships of acuity...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00336972

    authors: Sakitt B,Barlow HB

    更新日期:1982-01-01 00:00:00

  • Models describing nonlinear interactions in graded neuron synapses.

    abstract::An intracellular recording made from the retinal luminosity horizontal cell (LHC) demonstrated that repetitive red flashes enhanced the cell's responsiveness to red stimulus and depressed its responsiveness to green stimulus and that repetitive green flashes suppressed the cell's red response but produced little chang...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/s00422-002-0392-4

    authors: Hu JF,Liu Y,Liang PJ

    更新日期:2003-05-01 00:00:00

  • "Neural" computation of decisions in optimization problems.

    abstract::Highly-interconnected networks of nonlinear analog neurons are shown to be extremely effective in computing. The networks can rapidly provide a collectively-computed solution (a digital output) to a problem on the basis of analog input information. The problems to be solved must be formulated in terms of desired optim...

    journal_title:Biological cybernetics

    pub_type: 杂志文章

    doi:10.1007/BF00339943

    authors: Hopfield JJ,Tank DW

    更新日期:1985-01-01 00:00:00