Abstract:
:The reinforcement learning hypothesis of dopamine function predicts that dopamine acts as a teaching signal by governing synaptic plasticity in the striatum. Induced changes in synaptic strength enable the cortico-striatal network to learn a mapping between situations and actions that lead to a reward. A review of the relevant neurophysiology of dopamine function in the cortico-striatal network and the machine reinforcement learning hypothesis reveals an apparent mismatch with recent electrophysiological studies. It was found that in addition to the well-described reward-related responses, a subpopulation of dopamine neurons also exhibits phasic responses to aversive stimuli or to cues predicting aversive stimuli. Obviously, actions that lead to aversive events should not be reinforced. However, published data suggest that the phasic responses of dopamine neurons to reward-related stimuli have a higher firing rate and have a longer duration than phasic responses of dopamine neurons to aversion-related stimuli. We propose that based on different dopamine concentrations, the target structures are able to decode reward-related dopamine from aversion-related dopamine responses. Thereby, the learning of actions in the basal-ganglia network integrates information about both costs and benefits. This hypothesis predicts that dopamine concentration should be a crucial parameter for plasticity rules at cortico-striatal synapses. Recent in vitro studies on cortico-striatal synaptic plasticity rules support a striatal action-learning scheme where during reward-related dopamine release dopamine-dependent forms of synaptic plasticity occur, while during aversion-related dopamine release the dopamine concentration only allows dopamine-independent forms of synaptic plasticity to occur.
journal_name
Exp Brain Resjournal_title
Experimental brain researchauthors
Morris G,Schmidt R,Bergman Hdoi
10.1007/s00221-009-2060-6subject
Has Abstractpub_date
2010-01-01 00:00:00pages
307-17issue
3-4eissn
0014-4819issn
1432-1106journal_volume
200pub_type
杂志文章,评审abstract::While we walk through the environment, we constantly receive inputs from different sensory systems. For us to accomplish a given task, for example to reach a target location, the sensory information has to be integrated to update our knowledge of self-position and self-orientation with respect to the target so that we...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s00221-002-1146-1
更新日期:2002-08-01 00:00:00
abstract::The contributions of somatosensory, vestibular, and visual feedback to balance control are well documented, but the influence of auditory information, especially acoustic noise, on balance is less clear. Because somatosensory noise has been shown to reduce postural sway, we hypothesized that noise from the auditory mo...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s00221-015-4304-y
更新日期:2015-08-01 00:00:00
abstract::Vigilance is the ability to sustain attention to information for prolonged periods of time, particularly in environments where critical signals may be rare. Recent research in the domain of mind-wandering has suggested that processes associated with mind-wandering may underpin the typical decline in vigilance task per...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s00221-018-5438-5
更新日期:2019-02-01 00:00:00
abstract::The present study tested the idea that the visuomotor systems mediating prehension do not have independent access to pictorial cues processed by perceptual mechanisms. Individuals with visual form agnosia, whose perceptual systems are compromised but who have intact visuomotor control, were examined to determine wheth...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/pl00005731
更新日期:1997-08-01 00:00:00
abstract::Previous research has shown that Parkinson's-disease (PD) patients produce irregular movement paths during a rapid arm pointing task. The aim of this study was to investigate the movement paths of PD patients during a prehensile action to objects requiring different levels of precision. Thus, we sought to determine if...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s002210000468
更新日期:2000-10-01 00:00:00
abstract::Reports of spatial interactions between current and upcoming elements in a movement sequence could be due to intentional planning of a "global" action sequence (i.e., strategic effects), or to unintentional motor planning arising from merely paying attention to upcoming target objects (i.e., interference effects). The...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s00221-015-4511-6
更新日期:2016-04-01 00:00:00
abstract::In this study, we sought to examine the effect of experimentally induced somatic pain on memory. Subjects heard a series of words and made categorization decisions in two different conditions. One condition included painful shocks administered just after presentation of some of the words; the other condition involved ...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s00221-019-05534-x
更新日期:2019-07-01 00:00:00
abstract::Repetitive finger tapping is a well-established clinical test for the evaluation of parkinsonian bradykinesia, but few studies have investigated other finger movement modalities. We compared the kinematic changes (movement rate and amplitude) and response to levodopa during a conventional index finger-thumb-tapping ta...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s00221-013-3491-7
更新日期:2013-06-01 00:00:00
abstract::The purpose of this study was to determine if recovery of neurologically impaired hand function following isolated motor cortex injury would occur without constraint of the non-impaired limb, and without daily forced use of the impaired limb. Nine monkeys (Macaca mulatta) received neurosurgical lesions of various exte...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s00221-010-2157-y
更新日期:2010-05-01 00:00:00
abstract::The nature of spontaneous unitary activity of rat neocortex was investigated during slow wave sleep and urethane anaesthesia. Neurones in layer IV and V locations fired in a burst-pause pattern at a low burst repetition rate (0.5-4 per second) during both stage 3/4 sleep and urethane anaesthesia. Occasionally an alter...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/BF00237474
更新日期:1986-01-01 00:00:00
abstract::Previous studies have demonstrated the importance of both kinesthetic and auditory feedback for control of voice fundamental frequency (F0). In the present study, a possible interaction between auditory feedback and kinesthetic feedback for control of voice F0 was tested by administering local anesthetic to the vocal ...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s00221-008-1330-z
更新日期:2008-06-01 00:00:00
abstract::The time course of development of visual acuity for square wave gratings was measured behaviourally in a number of cats that were reared in total darkness until they were either 4 (5 cats) or 6 (1 cat) months of age. Less extensive measurements were also made on animals reared in a similar manner until they were eithe...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/BF00239811
更新日期:1978-04-14 00:00:00
abstract::We tested the hypothesis that some of the electromyographic (EMG) responses elicited in preactivated forearm muscles by transcranial stimulation of the human motor cortex are produced by activity in a disynaptic corticospinal linkage involving propriospinal-like interneurones with cell bodies in the spinal C3-4 segmen...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/BF00229634
更新日期:1996-06-01 00:00:00
abstract::Based on the observations that the psychostimulant drug amphetamine in combination with physiotherapy can promote recovery of brain function after brain injury, we have studied the ability of the vigilance promoting drug Modafinil to counteract 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine-(MPTP)-induced degeneration o...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/BF02259133
更新日期:1992-01-01 00:00:00
abstract::Young children rely heavily on vision for postural control during the transition to walking. Although by 10 years of age, children have automatic postural responses similar to adults, it is not clear when the integration of sensory inputs becomes fully developed. The purpose of this study was to examine this transitio...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s00221-005-0109-8
更新日期:2006-01-01 00:00:00
abstract::Bradykinin is an endogenous nonapeptide known to induce pain and hyperalgesia to heat and mechanical stimulation. Correspondingly, it excites nociceptors in various tissues and sensitizes them to heat, whereas sensitizing effect on the mechanical response of nociceptors is not well established. Protein kinase C and TR...
journal_title:Experimental brain research
pub_type: 杂志文章,评审
doi:10.1007/s00221-009-1814-5
更新日期:2009-06-01 00:00:00
abstract::The purpose of the study was to determine the contributions of endpoint variance and trajectory variability to the endpoint accuracy of goal-directed isometric contractions when the target force and contraction speed were varied. Thirteen young adults (25 +/- 6 years) performed blocks of 15 trials at each of 2 contrac...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s00221-009-2126-5
更新日期:2010-04-01 00:00:00
abstract::During saccadic eye movements, images of external objects move rapidly across the retina. Small, unpredictable displacements imposed upon a target moving at saccadic velocity were detected with equal accuracy when (1) the retinal image velocity was caused by an eye movement, or (2) when the same velocity was produced ...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/BF00236664
更新日期:1980-01-01 00:00:00
abstract::It is known that, when both forearms are rotated rhythmically and symmetrically, the dominant hand leads in time by about 25 ms, irrespective of movement speed. Positron emission tomography was used to test the hypothesis that the asynchrony results from a functional hemispheric asymmetry. We found that in normal, adu...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s002210050428
更新日期:1998-06-01 00:00:00
abstract::Projections from the posterior thalamic regions to the striatum were studied in the cat by the anterograde tracing method after injecting wheat germ agglutinin-horseradish peroxidase conjugate (WGA-HRP) into the caudalmost regions of the lateroposterior thalamic nucleus (caudal LP), suprageniculate nucleus (Sg) and ma...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/BF00235934
更新日期:1985-01-01 00:00:00
abstract::The evidence on the impact of subthalamic nucleus deep brain stimulation (STN-DBS) on action restraint on Go/NoGO reaction time (RT) tasks in Parkinson's disease (PD) is inconsistent; with some studies reporting no effect and others finding that STN stimulation interferes with withholding of responses and results in m...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s00221-015-4531-2
更新日期:2016-04-01 00:00:00
abstract::Vibratory stimulation of the neck muscles can elicit illusory drift of a visual target; after vibration stops, motion in the opposite direction is perceived. This motion aftereffect (MAE) could be due to adaptation of proprioceptive mechanisms that encode head orientation, or at a stage where visual and proprioceptive...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s00221-007-0910-7
更新日期:2007-07-01 00:00:00
abstract::EMG responses, vertical and A-P shear forces and kinematics of "automatic postural responses" to unexpected translational perturbations in the headward and tailward directions were studied in cats. Muscles acting on the major joints of the forelimbs and hindlimbs were studied. Movement of the animals in response to pe...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/BF00238231
更新日期:1983-01-01 00:00:00
abstract::Successfully picking up and handling objects requires taking into account their physical properties (e.g., material) and position relative to the body. Such features are often inferred by sight, but it remains unclear to what extent observers vary their actions depending on the perceived properties. To investigate thi...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s00221-016-4631-7
更新日期:2016-08-01 00:00:00
abstract::Clear vision of objects moving in three-dimensional space near an observer is attained by a combination of smooth-pursuit and vergence eye movements. The two systems must interact with the vestibular system to maintain the image of the object on the fovea. Previous studies showed that training with smooth-pursuit vest...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s00221-003-1777-x
更新日期:2004-05-01 00:00:00
abstract::This study examined the variability in movement end points in a task in which human subjects reached to targets in different locations on a horizontal surface. The primary purpose was to determine whether patterns in the variable errors would reveal the nature and origin of the coordinate system in which the movements...
journal_title:Experimental brain research
pub_type: 临床试验,杂志文章,随机对照试验
doi:10.1007/BF00241415
更新日期:1994-01-01 00:00:00
abstract::In recordings from two awake, behaving macaque monkeys we found that neurons in the crown of the prelunate gyrus differed in their responsiveness to simple visual stimuli. Neurons in the posterior part of the gyrus (area V4) responded strongly to stationary or moving bars, while neurons in the anterior part (area V4A)...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s00221-002-1112-y
更新日期:2002-07-01 00:00:00
abstract::The brain noradrenaline (NA) system is known to modulate ischemic neuronal damage, and the turnover of NA has been suggested to increase in the early recovery period following cerebral ischemia. Using HPLC and gas chromatography-mass spectrometry we analyzed the tissue levels of NA and its metabolites, 3,4-dihydroxyph...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/BF00230938
更新日期:1992-01-01 00:00:00
abstract::When two hands require different information in bimanual asymmetric movements, interference can occur via callosal connections and ipsilateral corticospinal pathways. This interference could potentially work as a cost-effective measure in symmetric movements, allowing the same information to be commonly available to b...
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/s00221-010-2244-0
更新日期:2010-06-01 00:00:00
abstract::The representation of the two eyes in striate cortex (V1) of Cebus monkeys was studied by electrophysiological single-unit recordings in normal animals and by morphometric analysis of the pattern of ocular dominance (OD) stripes, as revealed by cytochrome oxidase histochemistry in V1 flat-mounts of enucleated animals....
journal_title:Experimental brain research
pub_type: 杂志文章
doi:10.1007/BF02259100
更新日期:1992-01-01 00:00:00