Striatal action-learning based on dopamine concentration.

Abstract:

:The reinforcement learning hypothesis of dopamine function predicts that dopamine acts as a teaching signal by governing synaptic plasticity in the striatum. Induced changes in synaptic strength enable the cortico-striatal network to learn a mapping between situations and actions that lead to a reward. A review of the relevant neurophysiology of dopamine function in the cortico-striatal network and the machine reinforcement learning hypothesis reveals an apparent mismatch with recent electrophysiological studies. It was found that in addition to the well-described reward-related responses, a subpopulation of dopamine neurons also exhibits phasic responses to aversive stimuli or to cues predicting aversive stimuli. Obviously, actions that lead to aversive events should not be reinforced. However, published data suggest that the phasic responses of dopamine neurons to reward-related stimuli have a higher firing rate and have a longer duration than phasic responses of dopamine neurons to aversion-related stimuli. We propose that based on different dopamine concentrations, the target structures are able to decode reward-related dopamine from aversion-related dopamine responses. Thereby, the learning of actions in the basal-ganglia network integrates information about both costs and benefits. This hypothesis predicts that dopamine concentration should be a crucial parameter for plasticity rules at cortico-striatal synapses. Recent in vitro studies on cortico-striatal synaptic plasticity rules support a striatal action-learning scheme where during reward-related dopamine release dopamine-dependent forms of synaptic plasticity occur, while during aversion-related dopamine release the dopamine concentration only allows dopamine-independent forms of synaptic plasticity to occur.

journal_name

Exp Brain Res

authors

Morris G,Schmidt R,Bergman H

doi

10.1007/s00221-009-2060-6

subject

Has Abstract

pub_date

2010-01-01 00:00:00

pages

307-17

issue

3-4

eissn

0014-4819

issn

1432-1106

journal_volume

200

pub_type

杂志文章,评审
  • Differential effects of labyrinthine dysfunction on distance and direction during blindfolded walking of a triangular path.

    abstract::While we walk through the environment, we constantly receive inputs from different sensory systems. For us to accomplish a given task, for example to reach a target location, the sensory information has to be integrated to update our knowledge of self-position and self-orientation with respect to the target so that we...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s00221-002-1146-1

    authors: Glasauer S,Amorim MA,Viaud-Delmon I,Berthoz A

    更新日期:2002-08-01 00:00:00

  • Auditory white noise reduces postural fluctuations even in the absence of vision.

    abstract::The contributions of somatosensory, vestibular, and visual feedback to balance control are well documented, but the influence of auditory information, especially acoustic noise, on balance is less clear. Because somatosensory noise has been shown to reduce postural sway, we hypothesized that noise from the auditory mo...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s00221-015-4304-y

    authors: Ross JM,Balasubramaniam R

    更新日期:2015-08-01 00:00:00

  • Where is my mind? Examining mind-wandering and vigilance performance.

    abstract::Vigilance is the ability to sustain attention to information for prolonged periods of time, particularly in environments where critical signals may be rare. Recent research in the domain of mind-wandering has suggested that processes associated with mind-wandering may underpin the typical decline in vigilance task per...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s00221-018-5438-5

    authors: Neigel AR,Claypoole VL,Fraulini NW,Waldfogle GE,Szalma JL

    更新日期:2019-02-01 00:00:00

  • The removal of binocular cues disrupts the calibration of grasping in patients with visual form agnosia.

    abstract::The present study tested the idea that the visuomotor systems mediating prehension do not have independent access to pictorial cues processed by perceptual mechanisms. Individuals with visual form agnosia, whose perceptual systems are compromised but who have intact visuomotor control, were examined to determine wheth...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/pl00005731

    authors: Marotta JJ,Behrmann M,Goodale MA

    更新日期:1997-08-01 00:00:00

  • Disruptions in the reach-to-grasp actions of Parkinson's patients.

    abstract::Previous research has shown that Parkinson's-disease (PD) patients produce irregular movement paths during a rapid arm pointing task. The aim of this study was to investigate the movement paths of PD patients during a prehensile action to objects requiring different levels of precision. Thus, we sought to determine if...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s002210000468

    authors: Alberts JL,Saling M,Adler CH,Stelmach GE

    更新日期:2000-10-01 00:00:00

  • Sequential actions: effects of upcoming perceptual and motor tasks on current actions.

    abstract::Reports of spatial interactions between current and upcoming elements in a movement sequence could be due to intentional planning of a "global" action sequence (i.e., strategic effects), or to unintentional motor planning arising from merely paying attention to upcoming target objects (i.e., interference effects). The...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s00221-015-4511-6

    authors: LeBlanc KA,Westwood DA

    更新日期:2016-04-01 00:00:00

  • Memory for non-painful auditory items is influenced by whether they are experienced in a context involving painful electrical stimulation.

    abstract::In this study, we sought to examine the effect of experimentally induced somatic pain on memory. Subjects heard a series of words and made categorization decisions in two different conditions. One condition included painful shocks administered just after presentation of some of the words; the other condition involved ...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s00221-019-05534-x

    authors: Vogt KM,Norton CM,Speer LE,Tremel JJ,Ibinson JW,Reder LM,Fiez JA

    更新日期:2019-07-01 00:00:00

  • Comparing kinematic changes between a finger-tapping task and unconstrained finger flexion-extension task in patients with Parkinson's disease.

    abstract::Repetitive finger tapping is a well-established clinical test for the evaluation of parkinsonian bradykinesia, but few studies have investigated other finger movement modalities. We compared the kinematic changes (movement rate and amplitude) and response to levodopa during a conventional index finger-thumb-tapping ta...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s00221-013-3491-7

    authors: Teo WP,Rodrigues JP,Mastaglia FL,Thickbroom GW

    更新日期:2013-06-01 00:00:00

  • Minimal forced use without constraint stimulates spontaneous use of the impaired upper extremity following motor cortex injury.

    abstract::The purpose of this study was to determine if recovery of neurologically impaired hand function following isolated motor cortex injury would occur without constraint of the non-impaired limb, and without daily forced use of the impaired limb. Nine monkeys (Macaca mulatta) received neurosurgical lesions of various exte...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s00221-010-2157-y

    authors: Darling WG,Pizzimenti MA,Rotella DL,Hynes SM,Ge J,Stilwell-Morecraft KS,Vanadurongvan T,McNeal DW,Solon-Cline KM,Morecraft RJ

    更新日期:2010-05-01 00:00:00

  • The role of the anterior intralaminar nuclei and N-methyl D-aspartate receptors in the generation of spontaneous bursts in rat neocortical neurones.

    abstract::The nature of spontaneous unitary activity of rat neocortex was investigated during slow wave sleep and urethane anaesthesia. Neurones in layer IV and V locations fired in a burst-pause pattern at a low burst repetition rate (0.5-4 per second) during both stage 3/4 sleep and urethane anaesthesia. Occasionally an alter...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/BF00237474

    authors: Fox K,Armstrong-James M

    更新日期:1986-01-01 00:00:00

  • Interactions between auditory and somatosensory feedback for voice F0 control.

    abstract::Previous studies have demonstrated the importance of both kinesthetic and auditory feedback for control of voice fundamental frequency (F0). In the present study, a possible interaction between auditory feedback and kinesthetic feedback for control of voice F0 was tested by administering local anesthetic to the vocal ...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s00221-008-1330-z

    authors: Larson CR,Altman KW,Liu H,Hain TC

    更新日期:2008-06-01 00:00:00

  • The development of vision in cats after extended periods of dark-rearing.

    abstract::The time course of development of visual acuity for square wave gratings was measured behaviourally in a number of cats that were reared in total darkness until they were either 4 (5 cats) or 6 (1 cat) months of age. Less extensive measurements were also made on animals reared in a similar manner until they were eithe...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/BF00239811

    authors: Timney B,Mitchell DE,Giffin F

    更新日期:1978-04-14 00:00:00

  • A propriospinal-like contribution to electromyographic responses evoked in wrist extensor muscles by transcranial stimulation of the motor cortex in man.

    abstract::We tested the hypothesis that some of the electromyographic (EMG) responses elicited in preactivated forearm muscles by transcranial stimulation of the human motor cortex are produced by activity in a disynaptic corticospinal linkage involving propriospinal-like interneurones with cell bodies in the spinal C3-4 segmen...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/BF00229634

    authors: Mazevet D,Pierrot-Deseilligny E,Rothwell JC

    更新日期:1996-06-01 00:00:00

  • Evidence for a protective action of the vigilance promoting drug modafinil on the MPTP-induced degeneration of the nigrostriatal dopamine neurons in the black mouse: an immunocytochemical and biochemical analysis.

    abstract::Based on the observations that the psychostimulant drug amphetamine in combination with physiotherapy can promote recovery of brain function after brain injury, we have studied the ability of the vigilance promoting drug Modafinil to counteract 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine-(MPTP)-induced degeneration o...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/BF02259133

    authors: Fuxe K,Janson AM,Rosén L,Finnman UB,Tanganelli S,Morari M,Goldstein M,Agnati LF

    更新日期:1992-01-01 00:00:00

  • The influence of dynamic visual cues for postural control in children aged 7-12 years.

    abstract::Young children rely heavily on vision for postural control during the transition to walking. Although by 10 years of age, children have automatic postural responses similar to adults, it is not clear when the integration of sensory inputs becomes fully developed. The purpose of this study was to examine this transitio...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s00221-005-0109-8

    authors: Sparto PJ,Redfern MS,Jasko JG,Casselbrant ML,Mandel EM,Furman JM

    更新日期:2006-01-01 00:00:00

  • Excitation and sensitization of nociceptors by bradykinin: what do we know?

    abstract::Bradykinin is an endogenous nonapeptide known to induce pain and hyperalgesia to heat and mechanical stimulation. Correspondingly, it excites nociceptors in various tissues and sensitizes them to heat, whereas sensitizing effect on the mechanical response of nociceptors is not well established. Protein kinase C and TR...

    journal_title:Experimental brain research

    pub_type: 杂志文章,评审

    doi:10.1007/s00221-009-1814-5

    authors: Mizumura K,Sugiura T,Katanosaka K,Banik RK,Kozaki Y

    更新日期:2009-06-01 00:00:00

  • Timing variability and not force variability predicts the endpoint accuracy of fast and slow isometric contractions.

    abstract::The purpose of the study was to determine the contributions of endpoint variance and trajectory variability to the endpoint accuracy of goal-directed isometric contractions when the target force and contraction speed were varied. Thirteen young adults (25 +/- 6 years) performed blocks of 15 trials at each of 2 contrac...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s00221-009-2126-5

    authors: Poston B,Christou EA,Enoka JA,Enoka RM

    更新日期:2010-04-01 00:00:00

  • Perception of images moving at saccadic velocities during saccades and during fixation.

    abstract::During saccadic eye movements, images of external objects move rapidly across the retina. Small, unpredictable displacements imposed upon a target moving at saccadic velocity were detected with equal accuracy when (1) the retinal image velocity was caused by an eye movement, or (2) when the same velocity was produced ...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/BF00236664

    authors: Brooks BA,Yates JT,Coleman RD

    更新日期:1980-01-01 00:00:00

  • Hemispheric asymmetries and bimanual asynchrony in left- and right-handers.

    abstract::It is known that, when both forearms are rotated rhythmically and symmetrically, the dominant hand leads in time by about 25 ms, irrespective of movement speed. Positron emission tomography was used to test the hypothesis that the asynchrony results from a functional hemispheric asymmetry. We found that in normal, adu...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s002210050428

    authors: Viviani P,Perani D,Grassi F,Bettinardi V,Fazio F

    更新日期:1998-06-01 00:00:00

  • Topographical projections from the posterior thalamic regions to the striatum in the cat, with reference to possible tecto-thalamo-striatal connections.

    abstract::Projections from the posterior thalamic regions to the striatum were studied in the cat by the anterograde tracing method after injecting wheat germ agglutinin-horseradish peroxidase conjugate (WGA-HRP) into the caudalmost regions of the lateroposterior thalamic nucleus (caudal LP), suprageniculate nucleus (Sg) and ma...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/BF00235934

    authors: Takada M,Itoh K,Yasui Y,Sugimoto T,Mizuno N

    更新日期:1985-01-01 00:00:00

  • In Parkinson's disease on a probabilistic Go/NoGo task deep brain stimulation of the subthalamic nucleus only interferes with withholding of the most prepotent responses.

    abstract::The evidence on the impact of subthalamic nucleus deep brain stimulation (STN-DBS) on action restraint on Go/NoGO reaction time (RT) tasks in Parkinson's disease (PD) is inconsistent; with some studies reporting no effect and others finding that STN stimulation interferes with withholding of responses and results in m...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s00221-015-4531-2

    authors: Georgiev D,Dirnberger G,Wilkinson L,Limousin P,Jahanshahi M

    更新日期:2016-04-01 00:00:00

  • Adaptation of a bimodal integration stage: visual input needed during neck muscle vibration to elicit a motion aftereffect.

    abstract::Vibratory stimulation of the neck muscles can elicit illusory drift of a visual target; after vibration stops, motion in the opposite direction is perceived. This motion aftereffect (MAE) could be due to adaptation of proprioceptive mechanisms that encode head orientation, or at a stage where visual and proprioceptive...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s00221-007-0910-7

    authors: Seizova-Cajic T,Sachtler WL

    更新日期:2007-07-01 00:00:00

  • Automatic postural responses in the cat: responses to headward and tailward translation.

    abstract::EMG responses, vertical and A-P shear forces and kinematics of "automatic postural responses" to unexpected translational perturbations in the headward and tailward directions were studied in cats. Muscles acting on the major joints of the forelimbs and hindlimbs were studied. Movement of the animals in response to pe...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/BF00238231

    authors: Rushmer DS,Russell CJ,macpherson J,Phillips JO,Dunbar DC

    更新日期:1983-01-01 00:00:00

  • Effects of material properties and object orientation on precision grip kinematics.

    abstract::Successfully picking up and handling objects requires taking into account their physical properties (e.g., material) and position relative to the body. Such features are often inferred by sight, but it remains unclear to what extent observers vary their actions depending on the perceived properties. To investigate thi...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s00221-016-4631-7

    authors: Paulun VC,Gegenfurtner KR,Goodale MA,Fleming RW

    更新日期:2016-08-01 00:00:00

  • Adaptive changes in vergence eye movements induced by vergence-vestibular interaction training in monkeys.

    abstract::Clear vision of objects moving in three-dimensional space near an observer is attained by a combination of smooth-pursuit and vergence eye movements. The two systems must interact with the vestibular system to maintain the image of the object on the fovea. Previous studies showed that training with smooth-pursuit vest...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s00221-003-1777-x

    authors: Sato F,Akao T,Kurkin S,Fukushima J,Fukushima K

    更新日期:2004-05-01 00:00:00

  • Accuracy of planar reaching movements. I. Independence of direction and extent variability.

    abstract::This study examined the variability in movement end points in a task in which human subjects reached to targets in different locations on a horizontal surface. The primary purpose was to determine whether patterns in the variable errors would reveal the nature and origin of the coordinate system in which the movements...

    journal_title:Experimental brain research

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1007/BF00241415

    authors: Gordon J,Ghilardi MF,Ghez C

    更新日期:1994-01-01 00:00:00

  • Neurons with radial receptive fields in monkey area V4A: evidence of a subdivision of prelunate gyrus based on neuronal response properties.

    abstract::In recordings from two awake, behaving macaque monkeys we found that neurons in the crown of the prelunate gyrus differed in their responsiveness to simple visual stimuli. Neurons in the posterior part of the gyrus (area V4) responded strongly to stationary or moving bars, while neurons in the anterior part (area V4A)...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s00221-002-1112-y

    authors: Pigarev IN,Nothdurft HC,Kastner S

    更新日期:2002-07-01 00:00:00

  • Brain cortical tissue levels of noradrenaline and its glycol metabolites: effects of ischemia and postischemic administration of idazoxan.

    abstract::The brain noradrenaline (NA) system is known to modulate ischemic neuronal damage, and the turnover of NA has been suggested to increase in the early recovery period following cerebral ischemia. Using HPLC and gas chromatography-mass spectrometry we analyzed the tissue levels of NA and its metabolites, 3,4-dihydroxyph...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/BF00230938

    authors: Gustafson I,Lidén A,Wieloch T

    更新日期:1992-01-01 00:00:00

  • Resource-demanding versus cost-effective bimanual interaction in the brain.

    abstract::When two hands require different information in bimanual asymmetric movements, interference can occur via callosal connections and ipsilateral corticospinal pathways. This interference could potentially work as a cost-effective measure in symmetric movements, allowing the same information to be commonly available to b...

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/s00221-010-2244-0

    authors: Aramaki Y,Osu R,Sadato N

    更新日期:2010-06-01 00:00:00

  • Laminar, columnar and topographic aspects of ocular dominance in the primary visual cortex of Cebus monkeys.

    abstract::The representation of the two eyes in striate cortex (V1) of Cebus monkeys was studied by electrophysiological single-unit recordings in normal animals and by morphometric analysis of the pattern of ocular dominance (OD) stripes, as revealed by cytochrome oxidase histochemistry in V1 flat-mounts of enucleated animals....

    journal_title:Experimental brain research

    pub_type: 杂志文章

    doi:10.1007/BF02259100

    authors: Rosa MG,Gattass R,Fiorani M Jr,Soares JG

    更新日期:1992-01-01 00:00:00