Abstract：
:Dopamine neurons appear to code an error in the prediction of reward. They are activated by unpredicted rewards, are not influenced by predicted rewards, and are depressed when a predicted reward is omitted. After conditioning, they respond to reward-predicting stimuli in a similar manner. With these characteristics, the dopamine response strongly resembles the predictive reinforcement teaching signal of neural network models implementing the temporal difference learning algorithm. This study explored a neural network model that used a reward-prediction error signal strongly resembling dopamine responses for learning movement sequences. A different stimulus was presented in each step of the sequence and required a different movement reaction, and reward occurred at the end of the correctly performed sequence. The dopamine-like predictive reinforcement signal efficiently allowed the model to learn long sequences. By contrast, learning with an unconditional reinforcement signal required synaptic eligibility traces of longer and biologically less-plausible durations for obtaining satisfactory performance. Thus, dopamine-like neuronal signals constitute excellent teaching signals for learning sequential behavior.
journal_name
Exp Brain Resjournal_title
Experimental brain researchauthors
Suri RE,Schultz Wdoi
10.1007/s002210050467subject
Has Abstractpub_date
1998-08-01 00:00:00pages
350-4issue
3eissn
0014-4819issn
1432-1106journal_volume
121pub_type
杂志文章abstract：:Long-range tactile masking has been reported between mirror symmetric body locations. This suggests a general principle of contralateral inhibition between corresponding points on each side of the body that may serve to enhance distinguishing touches on the two halves of the body. Do such effects occur before or after...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s00221-015-4485-4
更新日期：2016-02-01 00:00:00
abstract：:Muscular fatigue, which reduces force output and position sense, often leads to increased sway and potential balance impairments. In contrast, visually-guided saccadic eye movements (saccades) can attenuate sway more than fixating gaze on an external target. The goals of this study were to determine whether the use of...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s00221-018-5384-2
更新日期：2018-12-01 00:00:00
abstract：:This study examined whether brain responses to transcranial magnetic stimulation (TMS) would be amenable to classical conditioning. Motor cortex in human participants was stimulated with TMS pulses, which elicited a peripheral motor response in the form of a motor evoked potential (MEP). The TMS pulses were paired wit...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s00221-007-1052-7
更新日期：2007-11-01 00:00:00
abstract：:Single unit activity was recorded from tuberoinfundibular neurones in urethane-anaesthetized pro-oestrous rats. Responses following single shock (0.2 Hz) stimulation of the preoptic area/anterior hypothalamus (PO/AH) or nucleus accumbens (ACB) were recorded and computed for 137 single units. More cells were shown, by ...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/BF00236546
更新日期：1985-01-01 00:00:00
abstract：:The topographical mapping of glial fibrillary acidic protein (GFAP)-immunoreactivity was performed in coronal serial sections of the rat mesencephalon, rhombencephalon and spinal cord. Relative to a background of poor or moderate overall staining of the mesencephalon, the interpeduncular nucleus, substantia nigra and ...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/BF00230695
更新日期：1989-01-01 00:00:00
abstract：:The firing patterns of alpha and gamma efferent fibres and of group I and group II afferent fibres innervating the gastrocnemius muscle were observed during spontaneous locomotor movements in the thalamic cat. Multi-unit discharges of each kind of fibre were obtained by electronic sorting of the action potentials from...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/BF00340493
更新日期：1986-01-01 00:00:00
abstract：:The present study was carried out to determine the effects of central nervous free fatty acids, lysophospholipids, or platelet activating factor (PAF), in a mouse facial carrageenan injection model of orofacial pain. Mice that received intracerebroventricular (I.C.V.) injection of arachidonic acid or oleic acid showed...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s00221-006-0672-7
更新日期：2006-10-01 00:00:00
abstract：:The main aim of the present study was to explore, by means of high-density EEG, the intensity and the temporal pattern of event-related sensory-motor alpha desynchronization (ERD) during the observation of different types of hand motor acts and gestures. In particular, we aimed to investigate whether the sensory-motor...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s00221-010-2371-7
更新日期：2010-09-01 00:00:00
abstract：:Visual feedback is essential when minimizing force fluctuations. Varying degrees of somatotopic organization have been shown in different regions of the brain for the upper and lower extremities, and visual feedback may be processed differently based on the body effector where feedback-based corrections are used. This...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s00221-009-1966-3
更新日期：2010-01-01 00:00:00
abstract：:The relationship between neuronal calcium binding protein content (calbindin D28K: CaBP and parvalbumin: PV) and vulnerability to ischemia was studied in different regions of the rat brain using the four vessel occlusion model of complete forebrain ischemia. The areas studied, i.e. the hippocampal formation, neocortex...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/BF00232193
更新日期：1990-01-01 00:00:00
abstract：:Our previous study showed an increase in total cholesterol level of the hippocampus after kainate-induced injury, but whether this is further metabolized to neurosteroids is not known. The first step in neurosteroid biosynthesis is the conversion of cholesterol to pregnenolone by the enzyme cytochrome P450 side chain ...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s00221-007-1209-4
更新日期：2008-03-01 00:00:00
abstract：:We use a vibrotactile-delayed match-to-sample paradigm to evaluate the effects of interference on working memory. One of the suggested mechanisms through which interference affects performance in working memory is feature overwriting: Short-term representations are maintained in a finite set of feature units (such as ...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s00221-010-2501-2
更新日期：2011-02-01 00:00:00
abstract：:The control of self-motion is supported by visual, vestibular, and proprioceptive signals. Recent research has shown how these signals interact in the monkey medio-superior temporal area (area MST) to enhance and disambiguate the perception of heading during self-motion. Area MST is a central stage for self-motion pro...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s00221-009-1990-3
更新日期：2010-01-01 00:00:00
abstract：:In rats under alpha-chloralose or without general anesthesia the effect of a lateral olfactory tract stimulus on the caudate nucleus electric activity was explored by bipolar macroelectrodes. The stimulation effectiveness and the reactivity of recording sites to somatic stimuli were systematically tested. Under these ...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/BF00237049
更新日期：1977-08-31 00:00:00
abstract：:Several non-physiological stimuli (i.e. pharmacological or electrical stimuli) have been shown to induce Fos expression in striatal neurons. In this work, striatal Fos (i.e. Fos-like) expression was studied after physiological stimulation, i.e. motor activity (treadmill running at 36 m/min for 20 min). In rats killed ...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/pl00005715
更新日期：1997-07-01 00:00:00
abstract：:The three-dimensional topography of the environment is a potentially important source of orienting information for animals, but little is known about how such features affect either navigational behaviour or the neural representation of place. One component of the neural place representation comprises the hippocampal ...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s00221-005-0138-3
更新日期：2006-02-01 00:00:00
abstract：:Absolute refractory periods of a subpopulation of corticomedial amygdala (CMA) neurones which project to the medial preoptic/anterior hypothalamic junction (MPH) via the stria terminalis were recorded in the female rat. Previous experiments have shown that this sub-population of CMA neurones is testosterone-sensitive ...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/BF00236571
更新日期：1981-01-01 00:00:00
abstract：:The 2-deoxyglucose (2-DG) autoradiographic technique was used to map functional activity in the central auditory system of the mongolian gerbil, throughout the period of functional onset. Uptake of 2-DG during exposure to 105 dB SPL wide band noise (WBN) was compared to silence in adults and in neonates at 12, 14, 16 ...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/BF00239360
更新日期：1982-01-01 00:00:00
abstract：:Previous findings have suggested that visuomotor programming can make use of learned size information in experimental paradigms where movement kinematics are quite consistent from trial to trial. The present experiment was designed to test whether or not this conclusion could be generalized to a different manipulation...
journal_title：Experimental brain research
pub_type： 临床试验,杂志文章,随机对照试验
doi：10.1007/s00221-002-1250-2
更新日期：2002-12-01 00:00:00
abstract：:Saslow and others have shown that the latency of foveating saccades can be altered by changing the offset time of the current fixation point relative to the onset of the peripheral target. Whether anticipatory saccades contributed to these results was not known. By the criteria of direction error and amplitude error t...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/BF00255238
更新日期：1987-01-01 00:00:00
abstract：:Adaptation of motor control to weightlessness was studied during a 7-day spaceflight. The maintenance of control of upright posture was examined during a voluntary raising movement of the arm and during the voluntary raising on tiptoe. In order to evaluate the contribution of visual cues, three types of visual situati...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/BF00231132
更新日期：1984-01-01 00:00:00
abstract：:Filial imprinting was originally proposed to be an irreversible process by which a young animal forms a preference for an object experienced early in life. The present study examined the effects of experience after imprinting on the stability of preferences of domestic chicks (Gallus gallus domesticus) for an imprinti...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s00221-011-2769-x
更新日期：2011-08-01 00:00:00
abstract：:We investigated in sheep the effects of stimulation of the thick afferent fibers running through the lingual nerve (LN) upon the activity of some of the muscles and medullary interneurons or motoneurons which are active during swallowing. Using electromyography (EMG), and extra- and intracellular neuronal recording, w...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s002210000361
更新日期：2000-06-01 00:00:00
abstract：:Recently, it has been reported that grasping with the left hand is more vulnerable to visual size illusions than grasping with the right hand. The present study investigated whether this increased sensitivity of the left hand for visual context extends to reaching. Left- and right-handed participants reached for targe...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s00221-010-2214-6
更新日期：2010-05-01 00:00:00
abstract：:A growing number of studies investigated anisotropies in representations of horizontal and vertical spaces. In humans, compelling evidence for such anisotropies exists for representations of multi-floor buildings. In contrast, evidence regarding open spaces is indecisive. Our study aimed at further enhancing the under...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s00221-018-5337-9
更新日期：2018-10-01 00:00:00
abstract：:We employed binocular magnetic search coils to study the vestibulo-ocular reflex (VOR) and visually enhanced vestibulo-ocular reflex (VVOR) of 15 human subjects undergoing passive, whole-body rotations about a vertical (yaw) axis delivered as a series of pseudorandom transients and sinusoidal oscillations at frequenci...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/pl00005639
更新日期：1997-04-01 00:00:00
abstract：:We examined the effect of the smoothness of motion on vection strength. The smoothness of stimulus motion was modulated by varying the number of frames comprising the movement. In this study, a horizontal grating translated through 360° of phase in 1 s divided into steps of 3, 4, 6, 12, 20, 30, or 60 frames. We hypoth...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s00221-017-5122-1
更新日期：2018-01-01 00:00:00
abstract：:Hand shaping during prehension involves intricate coordination of a complex system of bones, joints, and muscles. It is widely hypothesized that the motor system uses strategies to reduce the degrees of independent control. Both biomechanical constraints that result in coupling of the fingers and joints and neural syn...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s00221-014-4117-4
更新日期：2015-02-01 00:00:00
abstract：:To date, tactile distractor processing has primarily been investigated by focusing on the spatial characteristics of distractors and the impact of their presentation on the orienting of attention. In two experiments, we examined the influence of tactile distractors when the location of stimulus presentation was kept c...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s00221-014-3929-6
更新日期：2014-07-01 00:00:00
abstract：:Joint stiffness measurements during small transient perturbations have suggested that stiffness during movement is different from that observed during posture. These observations are problematic for theories like the classical equilibrium point hypothesis, which suggest that desired trajectories during movement are en...
journal_title：Experimental brain research
pub_type： 杂志文章
doi：10.1007/s002210000598
更新日期：2001-02-01 00:00:00
