Abstract：
:A computational model of a learning system (LS) is described that acquires knowledge and skill necessary for optimal control of a multisegmental limb dynamics (controlled object or CO), starting from "knowing" only the dimensionality of the object's state space. It is based on an optimal control problem setup different from that of reinforcement learning. The LS solves the optimal control problem online while practicing the manipulation of CO. The system's functional architecture comprises several adaptive components, each of which incorporates a number of mapping functions approximated based on artificial neural nets. Besides the internal model of the CO's dynamics and adaptive controller that computes the control law, the LS includes a new type of internal model, the minimal cost (IM(mc)) of moving the controlled object between a pair of states. That internal model appears critical for the LS's capacity to develop an optimal movement trajectory. The IM(mc) interacts with the adaptive controller in a cooperative manner. The controller provides an initial approximation of an optimal control action, which is further optimized in real time based on the IM(mc). The IM(mc) in turn provides information for updating the controller. The LS's performance was tested on the task of center-out reaching to eight randomly selected targets with a 2DOF limb model. The LS reached an optimal level of performance in a few tens of trials. It also quickly adapted to movement perturbations produced by two different types of external force field. The results suggest that the proposed design of a self-optimized control system can serve as a basis for the modeling of motor learning that includes the formation and adaptive modification of the plan of a goal-directed movement.
journal_name
Biol Cybernjournal_title
Biological cyberneticsauthors
Shimansky YP,Kang T,He Jdoi
10.1007/s00422-003-0452-4keywords:
subject
Has Abstractpub_date
2004-02-01 00:00:00pages
133-45issue
2eissn
0340-1200issn
1432-0770journal_volume
90pub_type
杂志文章abstract：:Fitzhugh's BVP model has been used by many people. Fitzhugh has pointed out that as the stimulus is increased the model has "inverted" behaviour. It is here shown that this is due to a lack of a mechanism of inactivation, and the model is adjusted by supplying such a mechanism, to give a new model, called BPH, which, ...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/BF00344278
更新日期：1982-01-01 00:00:00
abstract：:A new method based on neural networks to cluster proteins into families is described. The network is trained with the Kohonen unsupervised learning algorithm, using matrix pattern representations of the protein sequences as inputs. The components (x, y) of these 20 x 20 matrix patterns are the normalized frequencies o...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/BF00204658
更新日期：1991-01-01 00:00:00
abstract：:Movement of multiple segment limbs requires generation of appropriate joint torques which include terms arising from dynamic interactions among the moving segments as well as from such external forces as gravity. The interaction torques, arising from inertial, centripetal, and Coriolis forces, are not present for sing...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/BF00353957
更新日期：1982-01-01 00:00:00
abstract：:The proposal that rod outer segment length is optimal with respect to photon absorption and noise control is extended and tested in a number of species. We find good agreement with our optimality criterion in duplex retinae where rods act as detectors of one or a few photons, but not in all rod retinae nor in those wh...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/BF00203666
更新日期：1992-01-01 00:00:00
abstract：:For over 75 years it has been clear that the number of spikes in a neural response is an important part of the neuronal code. Starting as early as the 1950's with MacKay and McCullough, there has been speculation over whether each spike and its exact time of occurrence carry information. Although it is obvious that th...
journal_title：Biological cybernetics
pub_type： 杂志文章,评审
doi：10.1007/s00422-009-0321-x
更新日期：2009-06-01 00:00:00
abstract：:We have previously tried to explain perceptual inference and learning under a free-energy principle that pursues Helmholtz's agenda to understand the brain in terms of energy minimization. It is fairly easy to show that making inferences about the causes of sensory data can be cast as the minimization of a free-energy...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/s00422-010-0364-z
更新日期：2010-03-01 00:00:00
abstract：:In this work we show the application of a measure of entropy defined from the wavelet transform, namely the wavelet entropy (WS), to the study of event-related potentials (ERPs). WS was computed for ERPs recorded from nine healthy subjects with three different types of stimuli, among them target stimuli in a cognitive...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/s004220000212
更新日期：2001-04-01 00:00:00
abstract：:We consider the description of a nonlinear stochastic transduction in terms of its input/output distribution. We construct a sequence of approximating maximum-entropy estimates from a finite set of input/output observations. This procedure extends the Wiener theory to the analysis of nonlinear stochastic transducers a...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/BF00318425
更新日期：1986-01-01 00:00:00
abstract：:A multisegment, multijoint model of a falling animal is presented to examine the effectiveness of a two-stage control scheme in a zero-momentum self-righting maneuver. The model contains a much larger number of degrees of freedom than is required to execute a self-righting maneuver and is thus capable of providing mul...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/s004220050488
更新日期：1998-11-01 00:00:00
abstract：:On the basis of paleological evidence, it has been suggested that biological evolution need not necessarily be characterized by gradual change. Rather, evolutionary history may display saltatory periods of rapid speciation alternating with periods of relative quiescence, the whole dynamic being called punctuated equil...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/BF00203005
更新日期：1989-01-01 00:00:00
abstract：:A theoretical and experimental study on the detection of a square wave pattern of random dots is presented. Our theory applies to two-alternative forced choice experiments as well as to "seen"-"not seen" discrimination experiments. In our experiments we used the forced choice method. The theory provides a good descrip...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/BF00318084
更新日期：1983-01-01 00:00:00
abstract：:The peripheral auditory system of lizards has been extensively studied, because of its remarkable directionality. In this paper, we review the research that has been performed on this system using a biorobotic approach. The various robotic implementations developed to date, both wheeled and legged, of the auditory mod...
journal_title：Biological cybernetics
pub_type： 杂志文章,评审
doi：10.1007/s00422-016-0701-y
更新日期：2016-10-01 00:00:00
abstract：:We have attempted to reconcile the different patterns of distribution of interspike intervals that are found in motoneurones made to discharge by intracellular injection of constant current in reduced animal preparations and by voluntary control in human subjects. We recorded long spike trains from single motor units ...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/BF00204057
更新日期：1995-07-01 00:00:00
abstract：:For the Ornstein-Uhlenbeck neuronal model a quantitative method is proposed for the estimation of the two parameters characterizing the unknown input process, namely the neuron's mean input per unit time mu and the infinitesimal standard deviation per unit time sigma. This method is based on the experimentally observe...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/BF00201423
更新日期：1995-08-01 00:00:00
abstract：:The notion that biological systems come to embody optimal solutions seems consistent with the competitive drive of evolution. It has been used to interpret many examples of sensorimotor behavior. It is attractive from the viewpoint of control engineers because it solves the redundancy problem by identifying the one op...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/s00422-012-0514-6
更新日期：2012-12-01 00:00:00
abstract：:An intracellular recording made from the retinal luminosity horizontal cell (LHC) demonstrated that repetitive red flashes enhanced the cell's responsiveness to red stimulus and depressed its responsiveness to green stimulus and that repetitive green flashes suppressed the cell's red response but produced little chang...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/s00422-002-0392-4
更新日期：2003-05-01 00:00:00
abstract：:Evoked potential waveforms are generally of a dynamic, transient character. Consequently, their spectral energy distribution cannot be adequately described by time-invariant representations, such as the power density spectrum. Obviously, a spectro-temporal description is needed. Appropriate means for obtaining such de...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/BF00335365
更新日期：1981-01-01 00:00:00
abstract：:The impact of dendritic geometry on somatopetal transfer of the current generated by steady uniform activation of excitatory synaptic conductance distributed over passive, or active (Hodgkin-Huxley type), dendrites was studied in simulated neurons. Such tonic activation was delivered to the uniform dendrite and to the...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/s004220050473
更新日期：1998-09-01 00:00:00
abstract：:Illumination allows solid object perception to be obtained and depicted by a shading pattern produced by lighting. The shading cue, as one of solid perception cues (Gibson 1979), was investigated in regard to a white corrugated wave shape, using computer graphic device: Tospix-2. The reason the corrugated wave was cho...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/BF00317774
更新日期：1988-01-01 00:00:00
abstract：:In many applications of signal processing, especially in communications and biomedicine, preprocessing is necessary to remove noise from data recorded by multiple sensors. Typically, each sensor or electrode measures the noisy mixture of original source signals. In this paper a noise reduction technique using independ...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/s00422-001-0298-6
更新日期：2002-04-01 00:00:00
abstract：:The operation of a hierarchical competitive network model (VisNet) of invariance learning in the visual system is investigated to determine how this class of architecture can solve problems that require the spatial binding of features. First, we show that VisNet neurons can be trained to provide transform-invariant di...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/s004220100284
更新日期：2002-01-01 00:00:00
abstract：:Recent results demonstrate techniques for fully quantitative, statistical inference of the dynamics of individual neurons under the Hodgkin-Huxley framework of voltage-gated conductances. Using a variational approximation, this approach has been successfully applied to simulated data from model neurons. Here, we use t...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/s00422-014-0615-5
更新日期：2014-08-01 00:00:00
abstract：:The frequency sensitivity of weak periodic signal detection has been studied via numerical simulations for both a single neuron and a neuronal network. The dependence of the critical amplitude of the signal upon its frequency and a resonance between the intrinsic oscillations of a neuron and the signal could account f...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/s004220000203
更新日期：2001-03-01 00:00:00
abstract：:The present report presents an attempt to define the physiological parameter used to describe "voice tremor" in psychological stress evaluating machines, and to find its sources. This parameter was found to be a low frequency (5-20 Hz) random process which frequency modulates the vocal cord waveform and (independently...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/BF00340063
更新日期：1983-01-01 00:00:00
abstract：:In the first part of lifting movements, the trunk movement is surprisingly resistant to perturbations. This study examined which factors contribute to this perturbation resistance of the trunk during lifting. Three possible mechanisms were studied: force-length-velocity characteristics of muscles, the momentum of the ...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/s00422-005-0583-x
更新日期：2005-07-01 00:00:00
abstract：:We present a biologically oriented model that accounts for left-right discrimination in the cockroach's escape behavior. The model includes the main groups of neurons found to be involved in the escape response. Each one of the included neurons is described by the actual processes taking place in an individual neuron ...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/s004220050546
更新日期：1999-08-01 00:00:00
abstract：:A neural model is proposed for the spatiotemporal properties of simple cells in the visual cortex. In the model, several cortical cells are arranged on a ring, with mutual excitatory or inhibitory connections. The cells also receive excitatory inputs either from lagged and nonlagged cells of the lateral geniculate nuc...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/s004220050383
更新日期：1997-10-01 00:00:00
abstract：:Motion repulsion is the perceived enlargement of the angle between the directions of motion of two transparently moving patterns. An explanation of this illusion has long been sought for in the neural circuitry of the brain. We show that motion repulsion already arises from the statistical properties of the motion tra...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/s00422-005-0556-0
更新日期：2005-04-01 00:00:00
abstract：:After a brief description of the main anatomical structures subserving the oculomotor responses during combined vestibular and optokinetic stimulations, a mathematical model is presented. With respect to a previous model by Schmid et al. (1980), a more accurate definition of the roles of the neural mechanisms involved...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/BF00319980
更新日期：1982-01-01 00:00:00
abstract：:According to modern views of the cerebellum in motor control, each cerebellar functional unit, or microzone, learns how to execute predictive and coordinative control, based on long-term depression of the granule cell-Purkinje cell synapses. In the present paper, in light of recent experimental and theoretical studies...
journal_title：Biological cybernetics
pub_type： 杂志文章
doi：10.1007/s004220050462
更新日期：1998-08-01 00:00:00
